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I* Introduction 



An approach to examining the quality of survey data has recently been 
proposed by the Subcommittee on Nonsampllng Errors of the Federal Committee 
on Statistical Methodology. It Integrates post-hoc techniques and quality 
measurements into an "error profile/' Specifically, a survey research team 
constructs an error profile by examining possible sources of error arising 
in each phase of the survey operation. Under the auspices of the Subcommit- 
tee on Nonsampling Errors, the U.S. Bureau of the Census prepared an error 
profile of employment statistics as measured by the Current Population Sur^ 
vey (Brooks & Bailar, 1978) • The Subcommittee has, furthermore, recommended 
that error profiles be prepared for all Important federal statistical series. 
Such analyses can provide useful information to those who use the resulting 
statistics (as an indication of the limitations in the data) and to those 
who produce the statistics (as a guide to areas needing Improvements). 

The National Center for Education Statistics (NCES), as one of the 
major statlstical/data-gatherlrvg agencies and as a member of the Subcommit- 
tee on Nonsampllng Errors, realized the value of the work on error profiles. 
Therefore, NCES has requested that the Statistical Analysis Group in Educa- 
tion (SAGE) undertake the preparation of error profiles for two major recur- 
rent statistics. The SAGE effort should serve as a model for generating 
profiles on the major NCES statistics. 

Definition of a Process Profile 

A process or error profile documents survey procedures and Identifies 
potential sources of sampling and nonsampling error.* The profile provides 
information on the quality of the survey methods and of the survey data. 
Thus, it can serve two audiences: (1) survey managers and designers and 
(2) data users. For survey managers, the profile indicates which survey 
procedures, if any, require improvement. For users of the survey data, the 



The term process profile Is used rather than error profile because "error" 
is an ambiguous term. "Error" can be Interpreted in a statistical sense, 
or it can be used to describe the lack of precision of certain actions. 
Interpreted in the latter sense an "error" profile can be viewed as 
threatening to survey managers. 
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results of a process or error profile are used to describe the limitations 
of the data produced by the survey* 

A process profile differs from a post-valldatlon study along two dimen- 
sions: quantitative precision and completeness* The emphasis In a post- 
validation study Is on determining the accuracy or validity of the responses 
to the survey* Thus the post-valldatlon study may require extensive addi- 
tional data collection and replication of selected survey procedures* In 
contrast, the process profile has a more general focus In examining the 
adequacy of the entire survey process and In determining the relative con- 
tribution of various error sources to total error* It can be vleved as a 
documentation and evaluation effort that Is primarily conducted vrlth avail- 
able data* Secondary analyses and very limited data collection efforts, If 
any, are undertaken* 

Overview of this Rej>ort 

As-'^part of the process profile effort, the NCES and SAGE staff met to 
decide on the selection of the survey and of the statistics on which to 
focus* One of the selected surveys was t\\^ Fall Enrollment Survey conducted 
as part of the Higher Education General Information Survey (HBGIS)* As part 
of this survey, three statistics are of particular Interest: the count of 
full-time equivalent (PTE) students, the breakdown by race/ethnlclty, and 
the count of unclassified students* The present report focuses on the 
sources of error In these three variables* 

To provide documentation on the sources and extent of sampling and non- 
sampling error, this report reviews each of six stages of the survey* The 
processes for that stage are described followed by a discussion of the pos- 
sible errors arising from the process* The following stages are examined: 

Survey Objectives 

Description of HEGIS 

Needs for Information on higher education 
Purpose of HEGIS 

Purpose of the Opening Fall Enrollment Survey 

Method for developing and elaborating the purpose of HBGIS 

Match between the Information needs and purposes of HEGIS 

Sampling 

Definition of the HEGIS universe 

Sample selection for the Early Release Study 

Potential sources of error 
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Measurement Instruments 

Description of questionnaire 
Potential sources of error 

Data Collection 

Organization and description of the data collection effort 
Potential sources of error 

Data Preparation 

Description of the coding, editing, and imputation procedures 

Potential sources of error 

Errors identified by secondary analyses 

Errors identified by the post-validation study 

Data Analysis and Interpretation 

Description of data presentations 
Potential sources of error 



The final chapter provides some suggestions for improvements in the survey, 
based on the findings from the error profile* 
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II • Survey Objectives 

Description of the Higher Education General Information Survey (HEGIS) 

To understand the process of developing objectives for HEGIS, one must 
realize the extensive history behind this survey* The original mandate of 
the U*S* Office of Education (USOE), dating from 1867, required the agency to 
report on the condition and progress of education In the United States and 
Its territories* Since 1869"*1870, USOE has collected and reported statis- 
tics on higher education, such as enrollments, student characteristics, and 
faculty characteristics* Table 1 provides a portion of the data from one of 
the early surveys* As can be seen, many data elements of current surveys 
were being collected over 100 years ago* The objectives of the current 
survey are based. In part, on Information needs Identified In the 1800s* 

The data collection effort Increased over the years* Surveys were dls** 
trlbuted at various times throughout the year and suffered from a lack of 
consistency In format, terminology, definitions, and data categories* As a 
result, a significant reporting burden was placed on the respondents* 

The Higher Education General Information Survey (HEGIS) was designed to 
overcome these problems* It assembled the old surveys, put them Into a uni- 
form format, and bundled them Into a single package* This package was sent 
to Institutions prior to the academic fiscal year to give advance notice of 
the data requirements, and of the data processing requirements* Further- 
more, deadlines for the return of the different parts of the survey were set 
In accordance with times when data become available at the Institutions, 
with most of the due dates occurring between July 15 and December 15 • 

The first HEGIS survey was developed for use In 1966-67, one year after 
the founding of NOES* It was mailed to Institutions In June 1966* Although 
It contained some problem areas. It established the basic approach under 
which HEGIS has continued to function* HEGIS now consists of a package of 
survey questionnaires sent to over 3,000 universities and colleges* The 
composition of the package and the content of specific surveys varies from 
year to year* 

The HEGIS data base consists of a complete census of public and private 
.Institutions and two-year colleges* Table 2 presents a listing and descrip- 
tion of the surveys Included In HEGIS* In addition to the active surveys 
listed In the table, the following surveys were once Included but have been 

dropped from HEGIS: 
O ^5- 
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Table 1 

Portion of Table III — Statistics of colleges and collegiate institutions 
in the United States, compiled from the most recent reports sent to the 
United States Bureau of Education (1870) 
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Table 2 



Survey 

Institutional Character- 
istics 



I 

r 



Opening Fall Enrollment 
and Compliance 



Earned Degrees and Other 
Formal Awards Conferred 



Residence and Migration 
of College Students 



Full-Time Instructional 
Faculty in Higher Educa- 
tion 

College and University 
Libraries 
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Listing and Description of the Surveys included in 
the Higher Education General Information Survey (HEGIS) 



Data Items 

Name, address. Congressional district, county, telephone 
number, year established, sex of student body, previous-year 
enrollment, tuition and fees, control or affiliation, calen- 
dar system, highest degrees offered, type of program, accred- 
itation, and name, title, and function of principal admin- 
istrative officers. 

Full- and part-time enrollment for men and women undergradu- 
ates, graduates, first professional degree students, and 
unclassified students. Racial/ethnic data by selected major 
fields of study are collected in even-numbered years. 

First professional degrees by field; bachelor ^s, master's, 
and doctor's degrees by disciplines; and degrees and awards 
based on less than 4 years of work beyond high school* 
Racial/ethnic data for selected major fields are collected 
in odd-numbered years. 

Student enrollment classified by residence status (in-state/ 
out-of-state/foreign) , by sex, attendance status, level of 
enrollment, and program of study. 

Number of faculty, by rank, sex, tenure status, and length 
of contract; salaries and fringe benefits of full-time 
faculty • 

Name, address, and telephone number; number and salaries of 
full- and part-time staff, by sex and position; circulation 
and interlibrary loan transactions; book and media collec- 
tions; hours and days of service; operating expenditures by 
source; and revenue from Federal grants. 



Frequency 
of Collection 

Annual 



Annual 



Annual 



Biennial (origin- 
ally conducted 
quinquennially) 

Annual 



Biennial 
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Table 2 (contM) 



I 

r 



Survey 

Inventory of Physical 
Facilities 

Financial Statistics of 
Institutions of Higher 
Education 



Noncredit Adult Educa- 
tion in Colleges and 
Universities 



Data Items 

Total gross square feet at each institution; assignable 
space, classified by room use and type of activity. 

Current revenues, by sources (e,g,, tuition and fees ^ govern- 
ment, private gifts); current expenditures, by function 
(e.g., institution, research, plant maintenance and opera- 
tion); physical plant assets, and endowment investments and 
performance. Since fiscal year 1975, data are collected on 
changes in fund balances for each institution. 

Name and address of sponsoring unit or college; field of 
instruction; policies regarding GED and fee remission for 
the elderly; registrations. 



Frequency 
of Collection 

Biennial 



Annual 



Biennial 
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upper Division and Post Baccalaureate 

Enrollment (by major field) 
Summer Session Enrollment 
Enrollment Projections 

Table 3 displays a history of the HE6IS surveys. As a total system, HEGIS 
provides a national data bank on enrollment and other characteristics of 
Institutions of higher education. 

Further details on the Information needs and the purposes of HEGIS may 
be found In Appendix A. 

Purpose of the Fall Enrollment Survey 

The major purpose of the Fall Enrollment Survey within the HEGIS pack- 
age Is to collect and report on the fall enrollment count In colleges and 
universities In the United States and Its territories. These counts are 
then tabulated using the following variables: 

characteristics of the Institutions 
control of Institution 
level of Institution 
state or other area 

characteristics of students 
sex 

attendance status 
level of enrollment 

The purpose of the Fall Enrollment Survey has expanded over the years. 
The following Is an example. For years, NCES and the Office of Civil Rights 
(OCR) conducted separate but overlapping surveys. Then, In 1976, they agreed 
to cooperate In the conduct of a single fall enrollment survey. Such a sur- 
vey would reduce the response burden on the higher education Institutions by 
combining OCR^s biennial Fall Enrollment and Compliance Report (FECR) with 
the Fall Enrollment Survey Into one questionnaire. The agreement provides 
for the biennial collection of two additional data Items on students: race/ 
ethnicity and major field of study (for selected fields). 

Match between the Information Needs and the Purpose of HEGIS 

One potential source of error arises from the match or mismatch between 
the Information needs and the purposes of the survey. There Is a close match 
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between the Information needs and the purposes of HBGIS* The primary purpose 
of acquiring and disseminating meaningful statistics on higher education 
meets the needs of numerous federal and state agencies^ associations of 
higher education Institutions » and research organizations* Evidence for this 
statement comes from the report by Andrew (1980) titled Analysis of uses of 
HEGIS data* The report examined the questions of who uses the REGIS data 
and for what purpose. It summarised the results of the following activities: 

(1) a conventional literature review to determine the trends In HEGIS usage » 

(2) a statistical sampling of the relevant literature to determine the level 
of use» and (3) Interviews and surveys of users to obtain Information on the 
use of the HEGIS data and on opinions about Its use. The following conclu- 
sions resulted concerning . the Information needs served by HEGIS: 

HEGIS data have provided a foundation or base for the majority 
of reports and books that have affected public policy on higher 
education^ 

Enrollment and financial data are used much more extensively 
than other survey data for analyzing the Condition of Higher 
Education^ policy analysis, and for making decisions at state 
and local levels * 

Accuracy has improved . 

HEGIS is a system that would have to be invented If it were not 
already in place because of the increasing need for data in 
policy making and planning . 

The uses of HEGIS data have increased significantly in recent 
yearst particularly in the sophistication with which they are 
used. 



This report dld» however » note some problems with HEGIS that relate to 
the major purpose of acquiring and disseminating meaningful statistics on 
higher education. These are listed below. 



(Andrew, 1980, pp, Iv-xv) 



Timeliness of HEGIS data is seen as a major problem. 



HEGIS data have not been used as extensively as they might be In 
reporting on the condition of women and minorities in higher 
education because overhead or start-u^ costs In using HEGIS data 
for analysis Is relatively high . 
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HEGIS Is not being used as fully a s It might be for oollcy 

analysis., planning and evaluat ion by either bna^n o^^/^^-rT. 

slty scholars* 

More data are wanted on student characteristics tinA f 4nfln^ lal 
aid* ' 

The Andrew (1980) study also Indicated the partial achievement of the 
secondary purposes of HBGIS-~to reduce the response burden and to attain 
consistency. 

The collection of HEGIS data has had an impact on the disci pline 
and sophistication of data collect ion systems at institutio n^^ 
State levels * 

The collection of HEGIS d ata does not Impose a heavy h^^rA^n on 
iM^ltutlons since most ot the data would be rnllpcted by insti- 
tutions and/or state s for management purposes anyway . ■ 

Institutions are conce rned about the uses of HEGIS for comparl- 
son purposes. 

.There was general agreem ent that data are required from all of 
higher education h^^ause of differ ences amon^ in8ttt:..M on« .nT 
the uses to which the data are putT 

HEGIS data can be used for making comp arisons among aectora of 
higher education . =• 

(Andrew, 1980, pp. Iv-xv) 
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Ill* Sampling 



The following chapter describes the definition of the HEGIS universe 
and Identifies some potential sources of errors In the universe* The final 
section outlines the sampling procedures used for the Early Release Survey* 

Definition of the HEGIS Universe 

The universe for the HEGIS Fall Enrollment survey Is defined as the 
list of schools In the annual Education Directory, College & Universities , 
minus the system offices and central offices* This publication Is prepared 
jointly by the Division of Eligibility and Agency Evaluation (DEAE) of the 
Bureau of Higher and Continuing Education of the Office of Education and by 
the University and College Surveys and Studies Branch (UCSSB) of the Dlvl*-* 
slon of Postsecondary and Vocational Education Statistics of NCES* 

The HEGIS universe Is controlled by a master file (the Survey Control 
File or SCF)* The SCF Is maintained by NCES on magnetic tape; It Is created 
annually and updated cyclically with Information gathered by the various 
HEGIS surveys* The HEGIS file for each current year Is based on the HEGIS 
files for the previous year* Thus, the HEGIS XIII for 1978^79 consisted of 
all active records contained on the HEGIS XII SCF, plus the additional 
records of newly added Institutions, minus the Institutions dropped or 
Included with other institutions* The new Institutions are those that have 
been authorized by DEAE for Inclusion in the current survey* 

Criteria for listing in the Education Directory, Colleges & Universi- 
ties * This Directory lists institutions of higher education in the United 
States and its outlying areas (American Samoa, Canal Zone, Guam, Northern 
Marianas Islands, Puerto Rico, the Virgin Islands, and the Trust Territory 
of the Pacific Islands)* Such institutions must meet the following criteria 
for listing in the directory: 

(1) They are legally authorized to offer and are offering at 
least a one**year program of college-level studies leading 
toward a degree; 

(2) They have submitted the information required for listing; and 

(3) They meet one of the following criteria for listing; 

(a) The institution is accredited at the college level by an 
agency that has been listed as nationally recognized by 
the Secretary of Education; 
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(b) The Institution holds preaccredlted status at the col- 
lege level with a designated nationally recognized 
accrediting agency; 

(c) If the Institution Is public or nonprofit. It has quail-* 
fled under the "three-^lnstltutlonal-certlf Icatlon method" 
established by Section 1201 (a) (5) (B) of the Higher 
Education Act of 1965* By this method, the Secretary of 
Education verifies that not fewer than three accredited 
college-level Institutions have accepted and do accept 
an unaccredited Institution's credits, upon transfer, as 
though coming from an institution accredited by a 
nationally recognized accrediting agency* 

"College-level" means a post secondary associate, baccalaure- 
ate, post-baccalaureate or rabbinical education program* 

Institutions listed in the Directory are asked periodically to reestablish 
their eligibility for listing. Institutions cited in the Directory that do 
not presently meet these criteria, such as the few remaining institutions 
originally listed on the basis of "State approval," will be granted a 
reasonable time and opportunity to meet these criteria. 

Accreditation . No single level of government nor any public or private 
body or agency controls or supervises educational institutions in the United 
States. Accreditation of these institutions has evolved as a process 
involving voluntary self-evaluation by a school and appraisal by a group of 
peers. This process operates through nationally recognized accrediting 
agencies and associations and certain State bodies. These agencies or asso- 
ciations have established educational criteria to evaluate institutions in 
terms of their own objectives and to ascertain whether programs of educa- 
tional quality are being maintained. 

The U.S. Secretary of Education is required by statute to publish a 
list of nationally recognized accrediting agencies and associations deter- 
mined to be reliable authorities concerning the quality of education or 
training offered by educational institutions or programs. To carry out this 
function, the Secretary has established criteria for listing nationally 
recognized accrediting agencies and associations. The Advisory Committee on 
Accreditation and Institutional Eligibility assists the Secretary in deter- 
mining which accrediting bodies should be listed. Accrediting bodies that 
achieve initial recognition are reviewed every four years. 
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Three types of accrediting agencies currently exist* Six Regional 
Accrediting Commissions exist to accredit Institutions vlth liberal arts and 
general programs* In some cases, special programs may be accredited. One 
nationally recognized State Agency, the New York State Board of Regents, 
recognizes degree-granting programs and curricula offered by Institutions of 
higher education. Finally, the National Institutional and Specialized 
Accrediting Bodies review programs, departments, or schools that form only a 
portion of the total of post secondary Institutions* 

In addition to full accreditation, the U.S. Secretary of Education 
recognizes preaccredltatlon status as granted by the nationally recognized 
accrediting agencies and associations. To be recognized, such agencies and 
associations must use criteria and procedures that are appropriately related 
to those used for the award of accreditation. 

A list of nationally recognized accrediting and preaccredltlng agencies 
and associations appears In Appendix B. 

Limitations of the HEQIS Universe 

The HB6IS universe Is claimed to be a complete universe of Institutions 
of higher education that meets the HB6IS requirements. The deficiencies In 
the frame are rather small, probably less than 1 percent of the universe. 
These deficiencies are described below. 

Undercoverage . This results when eligible Institutions are missed In 

the sampling process. Two major reasons exist for the misses. 

1« Time lag between receipt of accreditation and entrance Into frame. 
The following provides an Indication of the magnitude of the addi- 
tions of new Institutions to the file from one year to the next 
(In this case, from 1979 to 1980). 



Type and Control 
of Institutions 



Number of 
Institutions Added 



Percentage of Total 
1978 Universe 



Public 
Four-Year 
Two-Year 



2 
6 



.36Z 
.65Z 



Private 
Four-Year 
Two-Year 



23 
10 



1.65% 
4.02Z 



These figures probably serve as an upper bound. Indicating the 
maximum level of undercoverage due to the lag between accreditation 
and universe Inclusion. 
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!• Refusal to cooperate* According to the NCES report Fall enrollment 
In higher education^ 1978» "complete data were received for all but 
two of the 3,173 units in the survey" (p« 201) « Assuming a base of 
3,173 units, this would result in a nonresponse rate of only «06 
percent* It should, however, be noted that the above statement 
' does not agree with the description of the universe that appears in 
the tape documentation for the Fall Enrollment Survey, specifically: 

# "The master file tape contains data for 3,170 institutions from 
a universe of 3,173 reporting units* Three institutions are 
not included because they have enrollments which are not 
applicable to the Fall Enrollment Survey* [Note that this 
implies a base of 3,170 rather than 3,173*] 

# Six institutions provided total enrollments only, without 
breakdowns by specific year of study and racial/ethnic group* 

# Ten institutions did not provide racial /ethnic data* 

# Three institutions could not provide a breakdown by year of 
study for graduate students* 

# Two institutions could not break down their unclassified 
students*" 

If one uses the figures given in the tape documentation, the rate 
of institutions failing to cooperate completely is *66 percent* 
This is still an extremely small percentage of the universe* 

Overc overage * This results when institutions are included in the 

universe but they should have been excluded* The reasons for the mistaken 

inclusions are as follows: 

1« Time lag between loss of accreditation and removal from the frame* 
The following provides an indication of the magnitude of removals 
from the HE6IS frame because of loss of qualifications: 

Type and Control Number of Percentage of Total 

of Institutions Institutions 1978 Universe 

Public 

Four-Year 0 0 

Two-Year 0 0 

Private 

Four-Year I ^07 

Two-Year 3 1*06 

This probably indicates an upperbound for such an error* 

2« Inclusion of vocational, post secondary institutions* Depending on 
one*s point of view, the inclusion of such institutions may or may 
not be considered as an instance of a problem of overc overage* More 
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and more of this type of institution are acquiring 
accreditation status to offer associate degrees in fields 
that may be considered as vocational rather than academic. 
They do, nevertheless, meet the technical specifications for 
inclusion in the HEGIS universe. Thus, if their inclusion 
is deemed f 'v be a problem, a special study may need to be 
undertaken v:^ develop new requirements for the HEGIS 
universe and determine the affect of their application. 

Misclassif ication due to reclassification. Not only are new institu- 
tions included in HEGIS and other institutions dropped from HEGIS, but 
institutions can change from one category to another. The following indi- 
cates the level of such reclassifications. 

New Classification 

Public Private 

Four-year Two-year Four-year Two-year 

I 1 

1 

6 

These data indicate that most of the reclassifications resulted because of 
the transformation of private two-year institutions into private four-year 
institutions. If such transformations occurred after the HEGIS data had 
been collected, the institution would be misclassif ied during that year of 
the survey • 

Results of a post-- validation survey . A thorough examination of the 
accuracy of the HEGIS universe would involve a post-validation study of a 
sample of eligible institutions. The procedures would involve a modifica- 
tion of those undertaken by McLaughlin and Bakke (1981) in a validation 
check on the NCES nonpublic elementary and secondary school file. 

Since the purpose of the present report is to provide a process profile 
rather than a post-validation study, we undertook an abbreviated version of 
the validation procedures. The purpose of the effort was to document 
instances of undercoverage or overcoverage. The entries in the Education 
Directory were compared with those in the Directory of California private 
postsecondary education institutions and public and private institutions 
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Previous 
Classifi- 
cation 



Public 
Four-year 
Two-year 

Private 
Four-year 
Two-year 



"approved for veterana /* Inatitutions that appeared in the California direc- 
tory as degree-granting institutions but did not appear in the Education 
Directory were identified. These institutions appeared in the following 
categories in the California directory: 

Number of California Institu"* 
tions Not Included in HEGIS 



Private 9 Nationally 

^credited Institutions 35 

Institutions Offering Speci- 
fied Degrees Approved by 
the Superintendent of Public 

Instruction 29 

Institutions Authorized to 
Operate as Degree-Granting 

Institutions 141 

All of the institutions in the first two categories and a 20 percent random 
sample of the institutions in the third category were contacted by telephone. 
Information was gathered as to familiarity with HEGIS, date of establish- 
ment, types of degrees offered, accreditation status, and enrollment counts* 

The results of these telephone conversations appear in Table 6« This 
indicates that only three institutions that appear to be eligible for HEGIS 
were not included.* This equals about 1.1 percent of the California insti- 
tutions in HEGIS. 

The institutions of higher education located in California comprise 
eight percent of the total of institutions in HEGIS. If we assume that this 
sample is representative of such institutions throughout the country, then 
we can estimate that approximately 36 eligible institutions may be missed by 
HEGIS each year. 

The opposite situation was also investigated. Four institutions 
appeared on the HEGIS listing that did not appear in the California direc- 
tory. The telephone conversations with the institutional representatives 
were unable to resolve the reason for the omission of these schools from the 
California directory. 



* All three institutions were private schools. Two of the three were two- 
year institutions and the third offered graduate degrees only. 
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Table 4 



Results of Survey of California 
Institutions Not Included in HBGIS Listings 



Classification of Results 

Appears to satisfy HEGIS criteria 

Submits information as part of 
another institution or branch 

Within California 

Outside California 

Appears to be ineligible for HEGIS 

Offers only partial credit toward 
degree 

Offers only noncredit courses 

Not nationally accredited 

Unable to classify 

Refuses to indicate accreditation 

Unable to contact (i*e*, no 
telephone number) 

TOTAL NUMBER OF SCHOOLS IN SURVEY 



Number of 
Institutions 



16 
11 



4 
13 
77 



74 
205 



Percentage of 
Institutions 

2*42 



12*90 
8*87 



3.23 
10.48 
62.10 



100.00 



Effects of Frame Limitations on Enrollment Statistics 

The limitations on the frame discussed above involve a small number of 
institutions, approximately 1 percent of the total universe* In addition, 
the problems of undercoverage and overcoverage tend to cancel each other in 
terms of total enrollments. This is not necessarily true for the categories 
of enrollment, such as grade level or ethnicity. New schools may have cer- 
tain characteristics and wrongly identified schools may have other charac- 
teristics. The two factors of undercoverage and overcoverage alone seem to 
indicate that the effect on the total enrollment figures would be minimal, 
but their effect on certain categories of enrollment may be substantial. 
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Another factor, that of the enrollment counts of Institutions Included 
In these frame problems, also Indicates that the effect on the HEGIS enroll- 
ment counts Is small* The total enrollment of the three California schools 
omitted from HEGIS but which appear to satisfy the HEGIS criteria equals 690 
or an average of 230 students per school. If we assume these figures for 
the entire universe, the enrollment counts may be missing as many as 8,280 
students (or «07 percent of the total 1978 enrollment counts)* 

Sample Selection for the Early Release Study 

In response to concerns about the timeliness of HEGIS data in general 
and of the Fall Enrollment results in particular, an Early Release Survey 
was developed to obtain preliminary estimates on fall enrollments in col- 
leges and universities* Although the process profile effort concentrated on 
the universe survey, we will, in this section, provide a brief description 
of the sampling method employed for the Early Release Survey* 

A two-*part sampling model was used to estimate enrollments for the fall 
1980 survey* The first part focused on obtaining enrollment estimates for 
the new institutions to be added to the HEGIS universe in 1980* A count of 
all the new institutions (including those who met the requirements for 
inclusion in 1980 but who had not done so in 1979) was compiled. Enroll- 
ments were estimated for these institutions by multiplving the number of new 
institutions by the average enrollment in new institutions with the same 
control and type* These average enrollments for new institutions were 
obtained from the 1976, 1977, and 1978 data. 

The second part focused on the 3,190 institutions included in the 1979 
universe. Enrollment data were solicited from a stratified random sample of 
999 institutions. The schools to be included in the survey were chosen by 
the method given by Lahiri (1950; see also Cochran, 1977). This is a method 
of sampling proportional to size which produces unbiased ratio estimators. 
The universe was first stratified by type (two-year vs. four-year) and by 
control (public vs. private). Within each stratum the sample of size N was 
drawn in the following manner: 

(1) Define T as the sum of the N largest values of X (total 
enrollment). 

(2) Draw a new simple random sample of size N. 
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(3) Draw a new random number between 1 and !• 

(4) If the sum of the N values in the sample is greater than the 
random number then retain the sample; otherwise reject it 
and return to step (2). 

The estimates from the two parts of the model were added together. 
This provided national estimates for the fall 1980 enrollments. It should 
be noted that this method, unlike standard methods for probability sampling, 
allows unbiased estimates of variance • 
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IV « Measurement Instruments 



This chapter discusses the development of the Fall Enrollment question- 
naire and describes the current instrument* Potential sources of errors 
arising from the content, wording, and format of the questionnaire are 
discussed* 

Description of the Questionnaire 

A HEGIS Fall Enrollment questionnaire has been in use since 1966* The 
questionnaire has been used to obtain information on student enrollments 
using the following dimensions: 

(1) degree credit and non-degree credit 

(2) resident and extension student 

(3) level of enrollment 

(4) full-time and part-time 

(5) sex 

(6) race/ ethnicity 

(7) type of course 

Additions, deletions, and modifications have been made in the forms and 
in these categories across the years* Table 5 provides a summary of the 
categories of information gathered in each year of the survey from 1965 to 
1978* This table was adapted from a similar table presented by Brown, 
Padgett, and Embry (1980)* The table indicates that the early forms gath- 
ered limited data on resident and extension students and on total first-time 
degree credit students separated by sex* From 1969 to 1972, similar forms 
were used that asked for grade-level breakdowns for the separate categories 
of resident and extension* Table 6 displays the category breakdowns used in 
the 1972 Fall Enrollment Survey* 

After 1972, it was decided to combine the enrollment counts for resident 
and extension students* Similar forms were used for a three-year span, from 
1973 until 1975* 

During this period of time, the Office of Civil Rights (OCR) gathered 
very similar kinds of data from higher education institutions under authori- 
zation of Section 80*6 (b) of the regulations implementing Title VI of the 
Civil Rights Act of 1964 (45 CDF 80*13) and similar provisions implementing 
Title IX of the Education Amendments of 1972* Table 7 presents the data 
categories included in the 1972 and 1974 Compliance Report Forms* 
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Table 3 



HEGIS Categories of Enrolltnenc Data, 1965-1978 
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s 


s 


s 


s 


s 


s 


s 


S 


s 


S 



o 

ERIC 



38 



07 



Table 5 (contM) 



C - Combined degree credit and non-degree credit 

G - Graduate categorized by first-year and beyond first-year 

P - Part-time data only 

R - Classified by race: Non-resident alien, Black Non-Hispanic, American Indian or Alaskan Native, 

Asian or Pacific Islander, Hispanic, With Non-Hispanic 
S - Data separated by sex 

T - Classified by type of program: Agriculture and Natural Resources, Architecture and Environmental Design, 
Biological Sciences, Business and Management, Engineering, Dentistry, Medicine, Veterinary Medicine, 
Law, Physical Sciences, All Other 

U - Unclassified categorized by undergraduate level and postbaccalaureate level 

X - Lower division categorized by first-time freshmen, other first-year, and second-year 

Y - Upper division categorized by third-year and fourth-year and beyond 



NOTE: 

J 

to 



If space is blank, category is not available • All categories separated by full- and part-time 
except where no ted « 
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Table 6 

Opening Fall Enrollment In Higher Education (Fall 1972) 





HEADCOUNT 


Full-time 
Equivalent 




MEN 


WOMEN 


TOTAL 


of Total 




Ful time Part- time 


Full'-time Part- time 




Headcount 



!• DEGREE-CREDIT STUDENTS 



A* Resident Students 
1* Undergraduates 
a. Lower Division 
b« Upper Division 
TOTAL 

2« Unclassified Students 

3* First-Professional Students 

4* Graduate Students 

5* TOTAL 

B* Extension Students 
1« Undergraduate level 
2. Unclassified 

3* Graduate of First-Professional 

level 
4* TOTAL 

Total Resident and Extension in 
Degree-Credit Programs 

D* First-Tine Degree-Credit Students 

II. NON-BACHELOR' S-DEGREE CREDIT STUDENTS 

A* Resident Students 

B. Extension Students 

C. TOTAL Resident and Extension 
Enrollment in Degree-Credit 
Programs 

D* First-Time Non-Bachelor's Degree 
Credit Students 



III. GRAND TOTAL 



Table 7 

Compliance Report of InstiCutions of Higher Education (Fall 1972) 



(1) (2) (3) (4) (5) (6) 

Spanish All Total 

American Surnamed Other All 

Indian Negro Oriental American Students Students 



A* FULL-TIME STUDENTS 

1* Undergraduates 

a. First year full-time students 
b* Second year full-time students 
c« Third year full-time students 
d« Fourth and subsequent year 

full-time students 
e« Total number full-time 

undergraduate students 

1 

J3 2. Graduate 

' a. First year full-time students 

b* Second and subsequent year 

full-time students 
c* Total number full-time 

graduate students 

3. First Professional 

a* First year full-time students 
b« Second and subsequent year 

full-time students 
c. Total number full-time 

professional students 

PART-TIME STUDENTS 

1. Undergraduate 
2« Graduate 

3. First Professional 
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Table 7 (cont'd) 

Compliance Report of Institutions of Higher Education (Fall 1974) 



r 

to 

00 

I 



PART H. 


Black 


American Indian 


Asian American 


Spanish 
Surnarocil 
American 


All otUiir 
Scudencu 


TOTAL 
Male 


TOTAL 
FemalL* 


Trvi'AI. 
All iitudchtu 


ENROLLMENT DATA 


Hale 1 Fomale 


Male 1 Fiittuile 


Hale 1 Female 


Hale 1 Female 


Male 1 Fi«male 









A. FuU-cime StuUisncs 

1 . UnilL»r graduate 

a. First Year 

b. ScseonJ Year 

c. Third Ycdr 

il. Fuurch and Stibsequenc Yoara 
Total Full-cime Undergraduate 
Scudcncs 

1 . Of thin tui:ul» huw many are 
CiVfiC time eouiimuiilcy/ 
jutiiov college transfers 

2. Unclatiuificd ScudeiitH 

3* Gi*«iduucu 

a. Mfisccrs bcyrdt- 

b. Ductural Dctircc 

c. Totui FtjU-cimc Craduacis 

Students 



U, First I'mfc^jsiunjl Scudciics 



tt, Harc-Clmb Students 

1. Undcrt^rnduatu 

2. Crudii.itc 

3. First Prufesstunal 
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Given the similarity In the HEGIS and OCR data requests, the Report on 
the eleventh annual conference on the Higher Education General Information 
Survey (1^75) recommended that the two surveys be combined. The surveys 
were combined beginning In 1976, with the forms being the same since then. 
Table 8 presents the categories as they appear In the most recent surveys. 
(See Figure 1 for selected portions of the questionnaire used In 1978.) It 
should be noted that the combined HEGIS-OCR survey (using a detailed form) 
Is conducted even-numbered years (e.g., 1978-79 school year), and the HEGIS 
Fall Enrollment Survey (using a simple card form) Is conducted during the 
odd-numbered years. The enrollment figures are examined by OCR for under-* 
graduate students and on a "first-year" and " beyond- the-f Irs t-year" basis 
for graduate students. These data enable OCR "to maintain a close scrutiny 
on Institutions' progress In providing educational opportunities for minori- 
ties" (National Center for Education Statistics, 1978, p. 4-1). In addition 
to total enrollment figures. Institutions must provide enrollment data by the 
following 10 selected fields of study: Agriculture and Natural Resources, 
Architecture and Environmental Design, Biological Sciences, Business and 
Management, Engineering, Dentistry, Medicine, Veterinary Medicine, Law, 
Physical Sciences, and All Other. This Information allows OCR to Identify 
discriminatory enrollment practices by selected fields of study and to 
determine the supply of minorities by these areas of specialization. 

Another modification was made In the form as a result of a recommenda* 
tlon In the Report on the eleventh annual conference on the Higher Education 
General Information Survey (1975). The conference participants stated that 
the Interpretation of the unclasslf led-stiident category is meaningless, since 
It Includes both undergraduate and graduate students* The recommendation, 
which was subsequently followed by HEGIS, was to separate the unclassified 
student category Into undergraduate unclassified students and graduate 
unclassified students. Thus, total undergraduate enrollment and total post^ 
baccalaureate enrollment could be determined. 

A more recent modification was Included In the form based on a recom- 
mendation from a post-valldatlon study of the HEGIS Opening Fall Enrollment 
Survey (Feng, 1979). The recommendation was to use a separate enrollment 
form for two-year colleges. "Some two-year colleges solve their enrollment 
classification dilemmas by lumping all students Into the unclassified cate- 
gory. In some Instances, from their point of view, this Is not unrealistic, 

O -29- 
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Table 8 

Fnll Enrol Incnt nnd ConpUnnce Report (Fall 1976) 



Name of Inafclfcufclan 



9000 - Stimnary 
(Total Enrollment) 



All Students Enrolled 
(Resident or Extension) 



I- PULL-TIME STUDENTS 



I 



ERIC 



A. Undergraduates » Total 

1. Plrst^tlne freahnen 

2. Other first*year 

3. Second^year 
A. Thlrd«*ycar 

5. Fourthly ear & beyond 

6. Unclassified Students^ 
Total 

I* Undergraduate level 
2. Poat^Baccalaureate 
level 

C. First Professional 
Students 

D. Graduate Students, 
Total 

1. Pirst«>year 

2. Beyond the first 
year 

Total Pull*Tine Students 



IX • PART-TIME STUDENTS 



A. Undergraduates » Total 
Flrat*tl»e frcshtaen 

2. Other flrat«*year 

3. Secfind*year 
A. Third-year 

5. Four Lh«*y ear & beyond 

6. Unclasalfled Students, 
Total 

1. Undergraduate level 

2. Post-Baccalaureate 
level 

C. First Professional 
Students 

D. Graduate Studenta» 
Total 

1. First-year 

2. Beyond the first 
year 

Total Part-Time Students 



GRAND TOTAL .ALL STUDEfrrg 



Line 
No. 



Non- 
Resident 
Allen 



Men 
(l) 



Worn. 
(2) 



Black 
Nan- 
Hispanic 



Men 
(3) 



Won. 



Amerlcsn 
Indian or 
Alaskan 
Native 



Men 
(5) 



Worn. 
(6) 



2. Institution 
Numher 



Asian or 

Pacific 

Islander 



Men 
(7) 



(8) 



Due Date Nat Later than 
December 15» 1976 



Hispanic 



Men 
(9) 



Worn. 
(10) 



Vlilte 
Non- 
Hispanic 



Men 
(11) 



Weill* 
(12) 



Form Approved 
OHB No. 51-R0733 



TOTAL 
(Sum of 
Columns (I) 
Through (12)) 



Men 
(13) 



Worn. 
(K) 



Normal 
Full-Tlme 
Credit Hour 
Load 



.(15) 



Total 
Crc'dlts 
Enrolled 
For 



(!6) 



PTE of Part-Time 
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since a student Is often permitted to take any course offering without 
establishing his status as a full-time, part- time, undergraduate, gradtiate, 
or even high school graduate. The effort made to "force" enrollment classi- 
fications to coincide with the four**year Institutions may not be the best 
solution". (p. 2-42). Following Peng^s suggestion, two-year Institutions 
receive a questionnaire that has many of the Inappropriate categories 
blacked out (e.g., enrollment counts for third- and fourth-year students). 

Potential Sources of Error 

Errors In survey data. Including nonresponse, can arise from the 
content, wording, and format of the measurement Instrument. The following 
paragraphs will describe what Is known about the HE6IS Fal3^ Enrollment 
Survey questionnaire. 

Match between questionnaire Items and Information needs . According to 
the Report on the eighth annual conference on Higher Education General 
Information Survey , the following Is a list of the Information needs con- 
cerning student characteristics: 

Educational major Ability 

Sex Motivation 

Ethnic background Attitudes 

Age Values 

Economic background Educational objectives 

Employment background 

Educational background 

Of these Information needs, the HE6IS Fall Enrollment Survey provides data 
on Institutional enrollments by sex, ethnic background, and educational 
major. Studies of Individual students such as the High School and Beyond 
Survey and the Recent College Graduate Survey do address some of the other 
Information needs on student characteristics. Since It has been an Impor** 
tant objective of HEGIS to keep the response burden on the Institutions to a 
minimum, additional response dimensions have not been Included In the Fall 
Enrollment Survey* If these Information needs are. In fact, considered 
critical, and If Items can be developed for these needs (which HEGIS respon- 
dents can answer), additional surveys might be undertaken using a sample of 
Institutions (as Is done with the Recent College Graduate Survey) • 

The need for Information on college majors Is only partially being 
served by the Fall Enrollment Survey. Data are gathered on enrollment in 10 
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selected fields to provide Inforaatlon on selective discrimination. Using 
the full range of educational majors would provide more useful Information; 
however, Including all of these categories in the questionnaire would slg^ 
nlflcantly Increase the response burden. This could result In a lowered 
response rate or a reduced reliability in the responses. As an alternative 
solution, certain other categories may be substituted for the current set 
(Berg, personal communication, 1982). 

Mlsperceptlon of survey objectives . Peng (1979) undertook the first 
post-*valldatlon study of the HEGIS Fall Enrollment Survey focusing on the 
fall 1977 survey. This study Included Interviews of a sample of 120 Insti- 
tutions to obtain estimates of reporting errors and reports of difficulties 
encountered In completing the HEGIS forms. One of the factors Identified as 
contributing to error was labelled "Inconsistent census dates and data 
coverage.** The problem was that the census date of the survey varied across 
Institutions; some submitted their reports to NCES promptly, while others 
delayed their submissions. The Issue really Involved a lack of Information 
on the survey objectives and the actual Information needs. Many Instltu^ 
tlons were uncertain as to the focus of the survey — the peak enrollment, the 
total number of students ever enrolled, the number of students currently 
enrolled, the students who completed the fall term, or the total number of 
students after the drop/add period. Thus, some Institutions (56%) deleted 
dropouts from their reports while others (44%) Included them. In addition, 
**many Institutions reported, as they were supposed to, the enrollment data 
at a given census date, while others Included those students enrolled after 
the report due date.** It might be appropriate to attempt to gain some con- 
sensus among participating institutions and to include the agreed-upon 
objectives In the data collection Instruments. This might follow the model 
used by the National Center for Higher Education Management Systems (NCHEHS) 
In the examination of portions of the Information Exchange Procedures (lEP) 
for their applicability and validity to the situation of major research 
universities. 

Response difficulties . Peng (1979) also Identified areas causing 
response difficulties. For example, of the 119 Institutions that partici- 
pated, 25 percent reported that they did not follow the questionnaire's 
definition for student levels. This problem was further examinee for each 
major student level. 
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As shown In Table 9, almost 21 percent of the Institutions with under- 
gradtiate students reported difficulties In distinguishing "first-time fresh- 
men" and **other first-year students," and 14 percent use one of the following 
procedures rather than undertaking extensive efforts to verify the student 
status: 

• arbitrary division between flrst-tlne freshmen and other 
first-year students (9.8Z) 

• automatic assignment to first- time freshmen (3*4%) 

• excluding from the HEGIS reports those students who could 
not be classified (1.2%) 

The results displayed In Table 10 Indicated that 15% of the Institutions 
reported difficulties la classifying undergraduate students at levels higher 
than freshmen. Major problems arose with the classification of transfer 
students* These were resolved by one of the following methods: 

• placement Into one category (10»1%) 

• random classification (2*7Z) 

• other (e«g«, arbitrary classification) (1.5%) 

Only •? percent consulted with department heads to determine the proper 
c lass If lea t Ion* 

Table 11 Indicates that about IS percent of the Institutions reported 
difficulties In responding to the category of unclassified student* Many 
Institutions resolved this problem by combining the unclassified students 
Into one category without a detailed breakdown of undergraduate and post- 
baccalaureate levels* In addition Peng (1979) mentioned a further problem 
with the category of unclassified students* ''As reported by many Institu- 
tions, this category frequently became a Mumping' spot for placing any 
student for whom sufficient Information was lacking at the time the HEGIS 
report was being prepared*** 

About 18 percent of the Institutions reported that they did not follow 
the definition for Indicating full-time versus part-time status* Institu- 
tions tended to over-report the full-time students and to under-report the 
part-time students* However, the overall effect on data accuracy was small, 
with the error being less than one percent* 



ERIC 



-33- 

52 



Table 9 

Percentage Distribution of Institutions by Methods of Classifying 
the First-Time Freshmen and Other First-Year Students 



Methods 


Total 


Public 


Private 


Institutions 


Four-year 


Two-year 


Four-year 


Two-year 


Total 


1 AA A<V 

100 • 07o 


100.0% 


100.0% 


100.0% 


100.0% 


Reported having 
difficulties 


20.6 


19.7 


35.9 


10.8 


28.0 


Assign students 
to the first- 
time freshmen 


3-4 


6.1 


4.8 


2.3 


0.0 


Arbitrary division 


9.8 


9.1 


17.7 


3.0 


23.2 


Extensive efforts 
to verify student 
status 


6.2 


A. 5 


9.3 


5.5 


4.8 


Excluding students 
who cannot be 
classified 


1.2 


0.0 


4.2 


0.0 


0.0 


Reported having no 
problem with NCES' 
definitions 


79-A 


80.3 


64.1 


89.2 


72.0 


Sample Size 


119 


26 


35 


43 


15 



(Taken from Table 2.1 in Peng, 1979) 
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Table 10 

Percencage DistrlbuCion of InstiCuclons by the Method Applied 
to Clftssify Students at the Level Higher Than Freshmen 



Methods 


Total 


Public 


Private 


Institutions 


Four-year 


Two-year 


Four-year 


Two-year 


Total 


100.0% 


100. OZ 


100.0% 


100.0% 


100.0% 


Reported having 
difficulties: 


15.0 


22.6 


24.2 


9.2 


4.8 


Randomly classify 
transfer students 




8.0 


1.4 


2.0 


0.0 


Put all students 
into one category 


10.1 


12.8 


18.6 


4.7 


4.8 


Consult with de- 
partment heads 


0.7 


1.8 


1.4 


0.0 


0.0 


Other (e.g., arbi- 
trary classifica- 
tion 


1.5 


0.0 


2.9 


1.4 


0.0 


Reported having no 
problem with NCES* 
definitions 


85.0 


77.4 


75.8 


91.8 


95.2 


Sample Size 


119 


26 


35 


43 


15 





(Taken from Table 2.2 in Peng, 1979) 
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Table 11 

Percentage Distribution of Institutions by Methods of Classifying 
Students to the Category of Unclassified Student 



Methods 


Total 


Public 


FrlvaCe 


Institutions 


Four— year 


Two— year 


Four— year 


Two— year 


Total 


100.0% 


100.0% 


100.0% 


100.0% 


100.0% 


Reported having 
difficulties: 


14-3 


26.6 


19.2 


8.3 


8.5 


RepL^rted one cat- 
egory with no 
breakdown of 
undergraduate and 

pOSu*~DciCCaX«IUreelU6 

levels 


8.9 


15.0 


14.7 


2.9 


8.5 


Arbitrary assign- 
ment 


3-6 


9.7 


1.8 


3.3 


0.0 

i 


Had special program 


2a 


2.0 


2.7 


2.1 . 


0.0 


Reported having no 
problem with NCES* 
definition 


85.4 


73. A 


80.8 


91.7 


91.5 


Sample Size 

- 


119 


26 


35 


43 


15 



(Taken from data reported in Peng, 1979) 
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Another problem area consists of the definition of full*-tlme equivalent 
(FTB)* The following are the Instructions given for computing the FTB 
enrollment of part-time students* 

(1) Use a method already employed In your Institution to compute 
FTE's for some other purpose* 

(2) Sum the credit hours for part-time students and divide by 
the normal full-time credit-hour load* (NORMAL FULL-TIME 
CREDIT-HOUR LOAD) Is usually determined by dividing the 
total number of credits required for completing the program 
by the number of terms normally required to obtain them* Do 
not confuse this with the minimum number of credit-hours 
required for a student to be classified full-time (75Z of a 
normal full-time load)* NOTE: Divide by the normal, or 
average, full-time load, not by the minimum full-time load* 
For most Institutions, this will be 15 credit-hours (not 12)* 

(3) Assign a fractional value of full-time to each part-time 
student, appropriate to your Institution, such as l/4, l/3, 
or 1/2* Remember that a student taking 3/4 (75Z) or more of 
a normal full-time load should be classified as a full-time 
student * 

The latter two methods require some calculation using credit-hour load or a 
proxy (e*g*, tuition fees based on credit-hour load)* According to the Peng 
(1979) study 84 percent of the Institutions used credit-hours and 1 percent 
used tuition fees as the Information source for classifying students as full- 
time or part-time* The remaining 15 percent used some other method* From 
this, we can assume that at least 15 percent of the Institutions are using 
their own method for calculating FTE (option 1)* This makes examination of 
the FTE data for potential error difficult, if not Impossible* One alterna- 
tive would Involve a post-valldatlon study of the methods used by Institu- 
tions to calculate FTE* 

Another problem arises from the provision for alternative methods In 
calculating FTE* By allowing Institutions to choose the method for calcu- 
lating FTE, unknown Inconsistencies arise among Institutions* Recognizing 
this problem, the report of the student workshop Included In the Report on 
the eleventh annual conference on the Higher Education General Information 
Survey (1975) recommended that the form Include an Item requesting schools 
to Indicate the method used for calculating FTE* This recommendation has 
not yet been followed* 



-37- 



Wording and format problems • The wording and format of a questionnaire 
can be critical to the gathering of accurate data. [See the SAGE Technical 
Report on reliability and validity of survey data by Russ-Bft (1980) for a 
discussion of some of the important considerations in questionnaire devel- 
opment*] Appendix C provides some suggestions for improving the wording and 
format of the HE6IS questionnaire* It should be recogniised that the major 
burden on the respondents is the retrieving and compiling of the information. 
Nevertheless, reducing the burden in reading the survey form may improve 
response accuracy* 
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V. Data Collection 

This chapter describes the data collection procedures used in the Fall 
Enrollment Survey. The procedures are completed by several different par- 
ties: NCBS, the survey contractor (i*e., VSE Corporation), state coordina-- 
tors, and institutions. Errors may occur at each stage. Thus, this chapter 
will identify the procedural contributions to survey error. 

Organization and Description of the Data Collection Effort 

The HEGIS package is mailed each year to all institutions included in 
the previous year's Education Directory plus any newly eligible institutions. 
Thus the HEGIS XIII package was mailed in early October based on the HEGIS 
XII Education Directory. Figure 1 displays the contents of the entire HEGIS 
package. Figure 2 presents the schedule for the data collection and process- 
ing operations for the Fall Enrollment survey. These figures are taken from 
the HEGIS XII Requirements and Specifications Manual (1978) > 

The questionnaire forms are sent to the institutions or to a state 
coordinator, depending on the type of institution and its location. In 37 
states, the materials were mailed to the state coordinator, who then dis- 
tributed them to the individual institutions. In seven states, materials 
were mailed to state agencies for some of the schools (e.g., public institu- 
tions) , while materials were mailed directly to other institutions within 
the state (e.g., private schools). In the remaining states, materials were 
mailed directly to the institutions. (Further details on the mailing proce- 
dures may be found in the HEGIS XIII Requirements and Specifications Manual .) 
Table 12 from the Peng (1979) post-validation study indicates that a state 
coordinator was involved in the data collection process for a majority of 
the schools. In some cases, the states actually prepared the HEGIS report 
based on data collected from individual institutions. 

In addition, most institutions, even those without a state coordinator, 
were required to prepare an enrollment report for their state. Results from 
the post-validation study indicated that 89 percent of the public four-year 
institutions, 94 percent of the public two-year institutions, 62 percent of 
the private four-year institutions, and 89 percent of the private two-year 
Institutions prepared enrollment reports for the state. Among the Institu- 
tions who prepared separate state reports, 64 percent indicated that these 
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Figure i 

CONTENTS OF HEGIS XIII PACKAGES 



I 


Quantity 


Letter: to the President^ 


1 


General instructions for the completion of all survey forms (to each of which is 
afflxed an undesignated label) 


3 


Instructions for updating the printout for the Directory of Colleges and 
Universities. 1978-79 


1 


Return labels (addressed to NCES) 


7 


Basic Forms (to each of which is affixed a **FROM" label): 

2300-2,3 Fall Enrollment and Compliance Report^ 
2300-3 Salaries, Tenure, and Fringe Benefits 
23004 Financial Statistics 


3 


Additional forms (to each of which is affixed a from label): 

2300-2. 1 Degrees and Other Formal Awards 
2300-1 Institutional Characteristics*' 
2300-8 Adult/Continuing Education^ 


2-3 


^Only one letter is sent to each institution. 

^ Letter from the Offlce for Civil Rights is included. 

^Previously eligible institutions receive two copies of a computer printout displaying data reported 
the previous year. Newly eligible institutions receive two copies of NCES Form 2300-1 (with no 
''FROM'' label affixed). Multicampus institution packages are clamped together. 

^ If the institution is included in the sample universe^ one copy of a special letter is included. 



(Taken from the HEGIS XIII Requireroents and Specifications Manual ) 
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Figure 2 



FECR SURVEY SCHEDULE 



EVENT 


DATE FOR 
PRELIM RPT 


DATE FOR 
FINAL RPT 


Mail-Out of questionnaire 
Edit programming initiated 
Output programming initiated 
Receipt Control Log activated 
Reminder Letter mailed 




Oct. 3, 1978 
Oct. 10, 1978 
Nov. 1, 1978 
Oct. 6, 1978 
N/A 


Oct. 3, 1978 
Oct. 10. 1978 
Nov. 1, 1978 
Oct. 10, 1978 
Oct. 30, 1978 


Due date of completed questionnaire 
Premachine edit initiated 
Premachine edit followup initiated 
First followup letter mailed 
Second followup (mailgram) mailed 




Oct. 15, 1978 
Oct. 6, 1978 
Oct. 16, 1978 

N/A 

N/A 


Nov. 15, 1978 
Oct. 10, 1978 
Oct. 10. 1978 
Nov. 27, 1978 
Dec. 5. 1978 


Followup telephone calls initiated 

Machine edit program operational 

Error resolution process initiated 

Programmed table shells delivered to survey director 

Nonresponse imputation for Preliminary Report initiated 


Oct. 16, 1978 
Nov. 1, 1978 

N/A 

N/A 
Dec. 14. 1978 


Dec. 13, 1978 
Nov. 1, 1978 
Dec. 11, 1978 
Feb. 1, 1979 
N/A 


Preliminary Report closeout 
Clean Data Base for Preliminary Report declared 
Preliminary Report lined tables delivered 
Preliminary Report white paper tables delivered 
Nonresponse imputatioh for flnal report initiated 


Dec. 8, 1978 
Dec. 13. 1^78 
Dec. 15, 1978 
Dec. 19. 1978 
N/A 


N/A 
N/A 
N/A 
N/A 
N/A 


Table-generation progiams operational 
Sample tables delivered to survey director 
Operational closeout 
Gean Data Base declared 
Table-Ready Data Base achieved 




Dec. 11. 1978 

XT/ A 

N/A 
N/A 
N/A 
N/A 


Jan. 9. 1979 

N/A 
June 29. 1979 
Aug. z**, lyvy 
Aug. 29, 1979 


Lined tables edited and delivered to survey director 
Review of lined tables completed by survey director 
Delivery of white paper tables to survey director 


N/A 
N/A 
N/A 


Sept. 19. 1979 
Oct. 5, 1979 

Hnt 1^ 1Q7Q 
\JCl, IJ$ 17/7 


Requirements and Specifications Manual: 










Vol I 


Vol. II 


Vol. Ill 


Vol. IV 


First Draft to UCSSB 


Oct. 6, 1978 


Nov. 14, 1978 


Feb. 6, 1979 


N/A 


Camera Ready Copy 
to UCSSB 


Jan. 5, 1979 


Feb. 23, 1979 


June 1. 1979 


Jan. 5, 1979 



(Taken from the HEGIS XIII Requiremeots and Specifications Manual) 
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Table 12 

Percentage of Institutions that Submitted the HE6IS Enrollment 
Report Through the State Coordinator 





All 


Public 


Privace 




InsCiCuCions 


Four-year 


Two-year 


Four-year 


Two-year 


Tocal 


100.0% 


100.0% 


100.0% 


100.0% 


100.0% 


Through the Scace 
Coord Ina Cor 


67.6 


57.3 


71.4 


71.1 


56.5 


Direccly Co NCES 


24.3 


17.8 


17.5 


28.9 


36.1 


Ocher (e.g., Scace 
prepared che 
reporc) 


8.0 


24.9 


11.1 


0.0 


7.4 


Sample Size 


119 


26 


35 


43 


15 



(Taken from Table 2-17 in Peng, 1979) 
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reports differed from HEGIS In terms of the Items or the definitions, and 35 
percent Indicated that the reporting period differed from HEGIS . 

The respondents*' at the colleges and universities vary from the presl-* 
dent to -a secretary. Table 13 displays the titles of the persons who signed 
the Fall Enrollment questionnaire as the respondent These people may or 
may not be the actual respondents, but they are the persons who are respon- 
sible for the report. The real question, however. Is whether the responsible 
person had the necessary resources to obtaln'and report accurate counts. 

The enrollment data reported by the Institutions were gathered from dlf** 
ferent sources* Table 14 shows the Information source used for determining 
the student level classification. About 70 percent of the Institutions use 
the credit-hours registered for the fall term, but over 6 percent used the 
students* self*-classlf Icatlon. Table IS displays the Information source used 
for determining f ull^^tlme or part*^tlme status. In this case, about 84 per- 
cent of the Institutions used the credit-hours registered for the fall term. 

The enrollment record-keeping systems used by the Institutions varied 
from completely computerized to completely manual. Table 16 from the post- 
valldatlon study Indicates the kinds of systems used by the Institutions. 
Almost half of the schools use a computer file for storing enrollment 
records. However, while over 90 percent of the public four^^year Institu- 
tions used computer files, less than eight percent of the private two-year 
Institutions did so. Among the latter group, about 62 percent maintained 
card files. 

The record-keeping system used by the Institutions affected the proce- 
dures undertaken for responding to the survey. Table 17 shows the procedures 
used. Thus, over 61 percent of the four-year public Institutions generated 
their enrollment reports using only the computer, while almost 29 percent 
used a partly computerized and partly manual operation. In contrast, only 
eight percent of the two-year private colleges used the computer for 
generating their enrollment reports, with another 16 percent using a partly 
computerized and partly manual operation. However, almost 73 percent 
compiled the fall enrollment data manually from a card file. 

The record-keeping systems and data collection operations also affected 
the level of effort: required to complete the Fall Enrollment report. Table 
18 from the post-validation study indicates that the average hours to com- 
plete the forms were 16 hours for the card form and 33 hours for the detailed 
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Table 13 



Titles of Institutional Representatives 
Who Signed HEGIS Fall Enrollment Forms 





Total 


Fiibllc 


Private 


Titles 


Institutions 


Four-year 


Two-year 


Four-year 


Two-year 


Total 


100.0% 


100.0% 


100.0% 


100.0% 


100.0% 


Registrar/Associate 
Registrar 


39^9 


28.1 


17.2 


63.5 


22.2 


Director /Manager of 
Institutional Research 


6.7 


20.1 


1.7 


3.5 


0.0 


Dean, Vice President, 
Vice Rector, Assistant 
Dean, Director 


A 1 


0.0 


3.4 


3.5 


16.7 


Dean/Director /Assistant 
Dean of Admissions 


A.l 


0.0 


10.3 


•1.2 


5.6 


President 


3.1 


0.0 


1.7 


2.4 


16.7 


Dean/Director of Student 
Services 


3.1 


0.0 


8.6 


0.0 


1.2 


Dean, Director, Vice 
President of 

Administrative Services/ 
Development/ Financial 
Aid/Financial Affairs/ 
Records/Research & 
Planning/Students 


9.3 


15.6 


10.3 


7.1 


5.6 


Research Associate/ 
Research Assistant/ 
Records Assistant/ 
Data Technician/ 
Secretary 


9.3 


21.9 


17.2 


0.0 


5.6 


Assistant /Recorder to 

President/Vlre President/ 
Provost /Dean 


4.7 


0.0 


5.2 


7.1 


0.0 


Consultant /Information 
Specialist/Statistician 


3.1 


3.1 


1.7 


4.7 


0.0 


Illegible/No title 


13.0 


3.1 


22.4 


8.2 


27.7 




Table 14 

Information Source for Student Level Classification 



Information 


All 


Public 


Private 


Source 


Institutions 


Four-year 


Two-year 


Four-year 


Two-year 


Total 


100.0% 


100.0% 


100.0% 


100.0% 


100.0% 


Student's self-clas- 
sification 


6.5% 


4.9% 


9.5% 


6.4% 


0.0% 


Credit hours regis- 
tered for fall 
term 


70.3 


64.8 


65.7 


74.2 


76.6 


Tuition fees 


0,0 


0.0 


0.0 


0.0 


0.0 


Other 


23.2 


30.4 


24.9 


19.4 


23.4 


Sample Size 


119 


26 


35 


43 


15 

■ 



(Taken from data reported in Feng> 1979) 
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Table 15 



Information Source for Determination of Full-Time 
versus Part-Time Status 



Information 
Source 


All 

T« el* 4 t*ii t* 4 rtri c 


Public 


Private 


Four-year 


Two-year 


Four-year 


Two-year 


Total 


.100.0% 


100.0% 


100 02 


inn n? 


1 f\f\ fW 


Student *s self-clas- 












sif ication 












Credit hours regis- 


84.3% 


85.9% 


98.1% 


74.2% 


88.4% 


tered for fall 








term 












Tuition fees 


1.0 


3.7 


0,0 


.8 


0.0 


Other 


14.7 


10.4 


1.9 


25.0 


11.6 


Sample Size 


119 


26 


35 


43 


15 



(Taken from data reported in Peng, 1979) 
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Table 16 

Enrollment Record-Keeping Systems by the Type and the Control 

of Institutions 



Record-Keeping 


Total 


Public 


Private 


System 


Institutions 


Four- year 


Two-year 


Four-year 


Two-year 


Total 


100.0% 


100.0% 


100.0% 


100.0% 


100.0% 


Card file 


27.9 


4.9 


8.6 


42.3 


62.3 


Computer file 


49.1 


90.6 


75.6 


24.5 


7.7 


Both computer file 
and card file 


11.5 


4.5 


7.4 


14.1 


26.3 


Others (directory 
class file) 


11.5 


0.0 


8.3 


19.1 


3.7 


Sample Size 


119 


26 


35 


43 


15 



(Taken from Table 2-12 in Peng, 1979) 
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Table 17 

Procedures for Compiling the Fall Enrollment Data 



Procedures 


All 


Public 


Private 


Institutions 


Four-year 


Two-year 


Four-year 


Two-year 


local 


100.0% 


100.0% 


100.0% 


100.0% 


100.0% 


Genera Ced by compuCer 


39.7 


61.2 


69.8 


18.7 


7.7 


Compiled manually 
from a card file 


30.9 


8.0 


6.1 


47.5 


72.6 


Aggregated from 
department reports 


.4 


0.0 


0.0 


.9 


0.0 


Partly computerized/ 
partly manual 


16.0 


28.8 


12.6 


13.4 


16.0 


Other 


12.9 


1.9 


11.5 


19.4 


3.7 


Sample Size 


119 


26 


35 


43 


15 



(Taken from Table 2-13 in Peng, 1979) 
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form* The variation among institutions was substantial* This variation was 
probably related to the size of the student enrollment and to the operations 
used for compiling the report* Some institutions required about 10 minutes 
to transcribe the data from a computer printout to a report form, while 
others spent days to compile the information manually. For this latter group 
of institutions, the burden of responding to the survey may decrease the 
motivation and ability to provide accurate data* 

The variety of data collection operations results in different response 
formats* The schools in most states, even those with a state coordinator, 
submitted the data on unedited NCES forms* Table 19 indicates the response 
formats used by states having a state coordinator* 

The goal of the data collection effort is to obtain a 100 percent 
response* Follow-up is the process used by NCES to remind and urge the 
institutions to respond in a timely fashion. These activities are directed 
toward institutions appearing in a Receipt Control Log from which a valid 
response has not been received as of a certain date* An example of the 
Receipt Control Log for the Fall Enrollment survey can be found in Figure 3. 

In the past, NCES staff logged each form when it was returned by the 
state coordinator or by the institution* Because of budget and staff reduc- 
tions, the NCES staff no longer log the forms upon thetr return* Each day 
batches of forms are taken from NCES and delivered to the data processing 
contractor, VSE Corporation (VSE)* Upon delivery the forms are grouped by 
area and are logged* 

Potential Sources of Error 

Several sources of error can arise from the data collection operations 
undertaken by the HE6IS Fall Enrollment survey. Below, we present and 
discuss available data on the effects of those errors. Most of these data 
come from the Peng (1979) post-validation study. 

Estimation or approximation of the enrollment data * Interviews of the 
institutional personnel responsible for the Fall Enrollment reports revealed 
that about 13 percent of the institutions had to estimate the enrollment 
counts for all or several levels of students* 
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Table 18 

Means, Standard Deviations , and Range of Person-Hours Required 
for Completing Fall Enrollment Forms 





All 
Institutions 


Public 


Private 


Four-year 


Two-year 


Four-year 


Two-year 


Card Form 












Mean 


16.1 


14.2 


7.8 


23.1 


5.8 


Standard Deviation 


72.7 


22.1 


10.5 


103.2 


7.5 


Range 












Lowest 




.1 


.3 


.2 


.1 


Highest 


650.0 


109.0 


40.0 


650.0 


35.0 


Detailed Form 












Mean 


32.5 


42.9 


21.8 


39.0 


10.4 


Standard Deviation 


86.9 


88.9 


25.0 


112.1 


8.4 


Range 












Lowest 


.2 


.2 


.5 


.5 


1.0 


Highest 


709.0 


709.0 


80.0 


700.0 


40.0 


Sample Size 


119 


26 


35 


43 


15 



(Taken from Table 2-15 in Peng, 1979) 
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Table 19 

Response Medium Used by Coordinated States 

All Coordinated States^ submit that data on unedited NCES forms, with the 
following exceptions: 



Response Medium 
Edited NCES Form 



State or Area 



Pennsylvania - except community colleges 



State Forms 



California - University of California only 
Florida public Z^year community colleges only 
Pennsylvania -> community colleges only 



Magnetic Tape 



Maine -» except University System 

Maryland 

Missouri 

New York - CUNY and SUNY only 

Oklahoma 

Vermont 

Washington - community colleges only 



Printouts 



Ohio - Miami University only 
Virginia ^ community colleges only 



NCES Imputes Data 



New York - rabbinical schools only 



^Most U*S* Service Schools submit data on the NCES forms through the State 
Coordinator; the U«S* Merchant Marine Academy and the U.S. Military Academy 
also use the NCES forms, but submit the forms directly to NCES. 
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Figure 3 

SAMPLE FECR SURVEY RECEIPT CONTROL LOG 



HEUIS XtU 



ALPHA 

SEUUENCE 

CCOE 



ALAOAHA 



iNSTITuniJN 
NAHE 



MIL ENROLLHENT AND CUHPLIANCE REPORT 
RECIEPl CONTRCL LOG 



DATE 09/20/76 PACE 0001 



C T S L 
FICE T Y T V 
CODE L P A L 



FINAL 



10-0010 ALAOAHA A C N UNIVEKSITV 001002 1 2 9 07 



liY 
PHONE 



DUP/ 
KEV 



— PKELIH— 

KlY I TO 
PLiNCHlFlLb 



(ITCH 
I 



FINAL 

EOITI KEV 
COHPt PUNCH 



HACH 
EOU 
CYCL 



KEHARKS 



10-01)20 ALAOAHA CHKtStlAN CULLEOE 0010J3 2 3 5 03 



10-0030 ALA LUm ACAi) ANO CULLEOE OlOiiSfr 2 3 5 03 



10-)*1^0 ALAUA.'IA SlATt iJNlVEKSITV 001005 1 2 3 07 



10-OOS) ALEXAriJl'M CITY STAft it 001007 1 3 5 03 



lO-OOuO AfrifcNS SI AT I CIjLLCCjE JOluOd 1 2 i Of» 



10-0J70 AtJHUKN U ALL CAHIMSIS 008695 1 7 2 Oa 



10-0090 AU«iJltN U "IAIN CAHPUS 001009 1 1 6 ua 



lO-UUO AUJUKN U AT HUNfGdHfRV 00tl3l0 L « 7 07 



10-0110 OIRHINCHAH STHN CULLEUE 001012 2 2 5 U4 



10-OUO 'tMt^iLK STATE Ok CliLLbGE 00913^ I 3 5 03 



10-01 iO UOTIArlCUCHLIi VALLEY CC 0UI(t2 1 3 *i U3 
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Type and Control 
of Institutions 



Percentage Reporting Estimation 
of Enrollment 



Public Pour-Year 
Public Two-Year 
Private Four-Year 
Private Two-Year 
Total 



9.8 
22a 
10*9 

0.0 
13.1 



Table 20 shows the responses of these schools as to which student levels 
were estimated* The levels ranged from first-year freshmen to graduate 
students. Only the public two-year Institutions indicated that they 
estimated freshmen {12.5%) and first-time freshmen (17.7%); however almost 
12 percent of the private four-year schools stated that they estimated lower 
division students (Including freshmen). 

The schools who estimated student enrollments were also asked to 
describe the method that they used. Table 21 displays these results. Most 
schools reported using some percentage of past reports or making a simple 
deduction. 

Mlsclasslf Icatlon of students . Problems with mlsclasslf Icatlon of stu- 
dents arose because of difficulties with the NCES definitions of student 
levels. Table 22 Indicates that such mlsclasslf Icatlon occurs most fre- 
quently for first-year and second-year students. 

Mlsclasslf Icatlon may occur for other reasons In addition to Institu- 
tions having problems with the KCES definitions. About 23 percent of the 
Institutions reported that some students were mlsclasslf led In the HEGIS 
report. The schools then estimated the magnitude of the mlsclasslf Icatlons. 
Translating these estimates Into overall Impact on the accuracy of the popu- 
lation value resulted In the following. It should be noted that these data 
come from self-reports of the Institutions and do not provide a true post- 
valldatlon. Assuming both lack of awareness of some mlsclasslf Icatlons and 
reluctance to acknowledge this mlsclasslf Icatlon, these data provide conser- 
vative estimates on the magnitude of the problem. 



Type and Control 
of Institutions 



Percentage of Students 
Mlsclasslf led 



Public four-year 
Public two-year 
Private four-year 
Private two-:year 
Total 



.3 
1.5 
.5 
.5 
.7 
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Table 20 



Percentage of Schools Reporting Estimation of 
Enrollments by Student Level 



Student Level 


Total 
Institutions 
(Who Estimate Enrollments) 


Public 


Private 


Four-year 


Two-year 


Four-year 


All levels 


46.9% 


13.4% 


50.0% 


53.8% 


Freshmen 


6.2 




12.5 




First- time fresh- 
men 






17.7 




Lower division 
students 


4.5 






11.8 


Four-year students 
and beyond 


9.7 




19.8 




Part-time under- 
graduates 


4.9 


19.8 




6.3 


Graduate students 


8.4 


66.8 






Irrelevant response 


10.8 






28.1 



(Taken from data reported in Peng, 1979) 
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Table 21 

Percentage of Respondents Using Different Methods 
of Estimating School Enrollments 



Basis of Estimate 


Total 
Institutions 
(Who Estimate 
Enrollments) 


Public 
Four-year 


Public 
Two-year 


Private 
Four-year 


Departmental Reports 


10.1 




Q ^ 
7 »J 




Percent of Previous Reports 


34.8 


13.4 


42.3 


32.4 


Simple Deduction 


23.7 


43.5 


23.4 


17.7 


Degree Intent 


4.5 






11.8 


Irrelevant Response 


17.1 




5.1 


38.2 


Don't Know 


9.7 




19.8 





(Taken from data reported in Peng, 1979) 
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Table 22 

Percentage of Students Mlsclassified as Reported by Respondents 





Total 
Institutions 


Public 


Private 


Student Level 1/ 


Four-year 


Two-year 


Four-year 


Two-year 


Specific levels 
not specified 


1.08% 


.44% 


1.47% 




6.67% 


First-year 
students 


3^90 


1.15 


12.12 


.02 




Second-year 
students 


2.58 


.46 


8.59 


.02 




Third-year 
students 


.08 






.02 




Fourth-year 
students 


.01 


.46 




.02 




Third- and fourth- 
year students 


.04 




.15 






Undergraduates 
in general 


.02 


.09 








Graduate 


2/ 






2/ 




Unclassified 


.59 


2.14 


.79 







1/ Level as reported by respondents 

2/ Specific percentage was not given by respondents 

(Taken from Table 2-3 in Peng, 1979) 
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Multiple couats of student 3 > About 23 percent of the Institutions 
reported that some students had been counted more than once In their reports* 
The percentage of students counted twice ranged from tl to 10 percent among 
Institutions reporting double counts; the overall Impact on the accuracy of 
the total enrollment figures was small. The results shown In Table 23 Indi- 
cate that the total double counting was less than 1 percent. "However, when 
translated Into actual numbers, the percentage may mean that several thousand 
students were counted more than once" (Peng, 1979, p. 2-12). 

Omissions of students and Inclusion of dropouts. Such omissions and 
Inclusions can occur for a variety of reasons. A major reason Is that 
Institutions may fall or be unable to update their records for late regis- 
trations and dropouts. Some Institutions permit students to register or to 
drop out until late in the fall term. If so, enrollment reports produced 
earlier In the term may not reflect the enrollment later In the year. 

The 1977 Fall Enrollment survey that was the focus of Peng's post- vali- 
dation study (1979) had a due date of 15 October 1977. This Is an early 
date In the fall term for many Institutions. Indeed, about 38 percent of the 
Institutions Indicated that some students were omitted from the report 
because of the late registrations. As can be seen In Table 24, such omis- 
sions occurred at all levels. However, the magnitude of these errors was 
small, less than one percent. 

A problem related to the Inclusion of late dropouts Is the problem of 
omission of late registrants. About 44 percent of the Institutions reported 
that some students who later became dropouts were Included In the HEGIS 
report. 

Recognizing that the early due date for the survey may pose problems 
for the Institutions, the researchers asked whether the enrollment data 
would differ If the due date were set at 15 November Instead of 15 October. 
About 33 percent of the Institutions Indicated that the enrollment would 
differ. Among these Institutions, 80 percent reported the extra time would 
permit the Inclusion of late registrants and the exclusion of dropouts, 
while the remaining 20 percent stated that It would permit more verifica- 
tion of their records. 

In addition, the Institutions were asked what would be a more convenient 
due date. Table 25 presents these results separately for the shortened card 
form and for the detailed form. The majority of Institutions Indicated that 

57- 
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Table 23 

Percentage of Students Who Were Counted More than Once 
as Reported by Institution Personnel 





Total 
Institutions 


Public 


Pr: 


Lvate 


Student Level 11 


Four-year 


Two-year 


Four-year 


Two-year 2/ 


Specific level not 
specified 


•03 




.12 






First- time fresh- 
men 


• 83 






1.80 




Part-time under- 
graduates 


3/ 


3/ 








Graduate students 


•01 


.04 








Unclassified 
students 


•02 






.05 





1/ Levels as reported by respondents 
2/ No double-counts were reported 

3/ Specific percentage point was unknown, but reported to be very small 



(Taken from Table 2-4 in Peng, 1979) 
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Table 24 



Percentage of Students Not Included in the Report 
Due to Late Registration, as Reported by Institution Personnel 





Total 


Public 


Private 


Student Level 1^/ 


Institutions 


Four-year 


Two-year 


Four-year 


Two-year 


Specific levels 
not specified 


.19% 


.15% 


.41% 


.09% 


% 


Firs t-year 
students 


.31 


.05 


.81 


.14 




Second-year 
students 


.10 


.11 


.06 


.14 




Lower division 


.15 




.51 






Hiird-year 
students 


.06 






.14 




Fourth-year 
students and 
beyond 


.07 






.16 




Upper division 


.11 


.15 


.29 


.01 




Undergraduates 


.002 


.01 








Part-time 
students 


.09 




.19 






Graduate 
students 


.46 


.93 




.29 




Unclassified 


.26 


.03 


.81 


.02 


.07 


First- 
professional 


2/ 






11 





1^/ Levels as reported by respondents 
Ij Percentage was not known 

^/ The actual percentages were not reported by respondents 



(Taken from Table 2-5 in Peng, 1979) 



Table 25 

Due Dates Acceptable for Fall Enrollment Report 





All 


Public 


Private 


Due 
dates 


institutions 


Four- 


-year 


Two-year 


Four- 


.year 


Two-year 


card 


De- 
tailed 


Card 


De- 
tailed 


Card 


De^ 
tailed 


Card 


De- 
tailed 


Card 


De- 
tailed 


Total 


100.0% 


100.0% 


100.0% 


100.0% 


100.0% 


100.0% 


100.0% 


100.0% 


100.0% 


100.0% 


Oct. 15 
Oct. 25 
Nov. 1 
Nov. 15 
Dec. 1 
Dec. 15 
Jan. 1 
Jan. 15 
May 1 
July 15 


75.4 
1.2 
9.0 
6.0 
2.2 
.9 
.5 
2.9 
.4 


58.9 
1.2 
17.4 
9.4 
4.7 
1.7 
.5 
3.8 
.4 
.5 


78.3 

4.2 
12.2 

5.3 


71.0 

9.1 
12.2 

5.3 

2.4 


67.4 
4.1 
7.7 
7.3 
7.0 

1.4 


56.5 
4.1 

14.4 
5.6 

11.7 
1.2 

1.4 


80.8 

9.2 
4.0 
.5 

1.0 
4.5 


53.4 

24.3 
9.1 
2.7 
1.1 
1.0 
7.3 

1.1 


78.1 
21.9 


76.0 

5.9 
18.1 


Unknown 


1.5 


1.5 






5.1 


5.1 










Sample 
Size 


119 


26 


35 


43 


15 



(Taken from Table 2-16 in Peng, 1979) 
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15 October was acceptable for both forms. However, over 85 percent of the 
Institutions reported a due date of 15 November as acceptable. 

The due date for the 1978 Fall Enrollment survey was set at 15 November. 
The problems with reporting late registrations and dropouts have, presumably, 
disappeared for some but not all of the institutions. Another survey of the 
institutions would be needed to identify the magnitude of the problem. How- 
ever, as shown in the next chapter, about 50 percent of the schools return 
their forms after 1 December. 

Operational errors . Peng (1979) mentioned some administrative problems 
that affected the data such as failure to follow the instructions, failure 
to complete the forms, and computational errors. Table 26 displays the 
extent of such errors that were corrected during the editing operations for 
the 119 schools included in the survey. The editing and correcting of these 
forms is an important process that will be discussed in the next chapter. 

The post-validation study also investigated whether the quality of the 
data was related to the data processing system. A comparison was made of 
the measures of net differences between the data published by NCES and by 
the "most accurate** data constructed in the post-validation effort. Results 
from these comparisons, as shown in Table 27, indicated that institutions 
with computerized systems provided data with a higher degree of accuracy 
than institutions with other systems. 

The study did not, however, indicate the extent to which the involve- 
ment of the state coordinator affects the quality of the data by introducing 
or by eliminating errors. A determination of the role of the state coordi- 
nators could be undertaken through a study of the processing undertaken by 
these coordinators. Such a study would be most revealing if done in con- 
junction with the Fall Enrollment data collection effort. 
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Table 26 

Frequency of Corrections on Each Line Item In the Fall Enrollment Report 



Student level 



Y percent 



Full-Time Students 

A. Undergraduates, total 

1. First-time freshmen 

2. Other first-year 

3. Second-year 

4. Third-year 

5. Fourth-year and beyond 

B. Unclassified students, total 

1. Undergraduate level 

2. Post-baccalaureate level 

C. First-Professional students 

D. Graduate students, total 

1. First year 

2, Beyond first year 

Total full-time students 



115 
115 
104 
112 
70 
67 

79 
73 
32 

27 

50 
50 
42 

119 



10 
4 
6 
5 
2 
2 

3 
11 
7 



2 
5 
5 



8.7 
3.5 
5.8 
4.5 
2.9 
3.0 

3.8 
15.0 
22.0 



4.0 
10.0 
11.9 

5.9 



Part-Time Students 

A. Undergraduates, total 

1. First-time freshmen 

2. Other first-year 

3. Second-year 

4. Third-year 

5. Fourth-year and beyond 

B. Unclassified students, total 

1. Undergraduate level 

2. Post-baccalaureate level 

C. First-Professional students 

D. Graduate students, total 

1. First year 

2. Beyond first year 

Total part-time students 



104 
94 
88 
97 
59 
59 

85 
83 
38 

17 

48 
48 
38 

116 



7 
3 
5 
4 
2 
3 

6 
11 
7 



1 

4 
5 



6.7 
3.2 
5.7 
4.1 
3.4 
5.1 

7.1 
13.3 
18.4 



2.0 
8.3 
13.2 

2.6 



Total, All students 



119 



8 



81 



6.7 



NOTE: 

N » Number of schools with students in that level of classification. 
F » Frequencies of changes or correction. 
Y percent « F/N x 100 
^""-le percentages were unweighted. 

HMafflialcea from Table 2-10 in Peag, 1979) " 



Table 27 



Percentage of Net Errors by Data-Compiling System for Selected 

Student Levels 1/ 



student level 


Data-compiling system 


Computerized systems 


Other systems 


Total 


.26% 


- .85% 


Full-time undergraduate, total 


.06 


- 1.63 


Full-time first-time freshmen 


.72 


3.31 


Other first-year full-time 
students 


- .91 


-11.36 


Full-time unclassified 
students 


1.63 


-21.54 


Total part-time students 


.31 


- 2.77 


Sample size 


61 


58 



1/ The percentage was computed as follows: 
"J J 

Z w.d. / z w.p. . 100, where 
i = 1 1 1 i s 1^ 1 

w. is the sample weight, d. is the net difference between the HEGIS published 
data and the reconstructed validation data, and p. is the published HEGIS 
data for the i*"" institution in the group. ^ 

(Taken from Table 2-14 in Peng, 1979) 
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VI* Data Preparation 



The editing of the HEGIS Fall Enrollment survey provides some quality 
control on the data collection operations. The procedures followed in the 
editing operation are described below. Later sections in this chapter pro- 
vide some indication of the level of the quality of the data being submitted, 
the extent of editing and imputation, and the quality of the resulting data. 

Description of the Coding, Editing, and Imputation Procedures 

All of these operations are handled by a survey contractor. The steps 
in this process are depicted in Figure 4. As batches of forms are delivered 
to the survey contractor from NCES, they are grouped and logged. Then a scan 
edit prepares the forms to be machlne^^readable and identifies any glaring 
errors or inconsistencies. The manual edit attempts to identify and resolve 
such problems as missing totals. Although reports of such errors are pre*^ 
pared by the survey contractor for NCES, these reports are not retained. 
However, all the information on the results of the manual and mactiine edits 
are retained with the schools^ HEGIS form at NCES or at OCR. 

Following the manual edit, the forms are again logged and sent to key^ 
punch. The keypunch operation achieves a level of accuracy of at least 99.5 
percent. The listing of the keypunch output is checked for errors and then 
the forms enter the machine edit. 

The machine editing follows the HEGIS Requirements and Specifications 
Manual , checking for internal consistency and for similarity with the previ-* 
ous yearns data. The latter involves checks on presence or absence in cer- 
tain data fields from one year to the next and checks on tolerance levels.** 
These tolerance levels for changes from one year to the next are set by the 
NCES staff. In general, however, decreases in enrolltnAr.t have tighter 
tolerance intervals than increases in enrollment. 

The final data files contain only the corrected data. Fields are left 
for the purpose of flagging imputed data. Data that were corrected at 
earlier stages and data that remain outside the tolerance levels do not 
receive any flags on the files. And, in reality, no data are ever flagged 
in HEGIS. 

Editing steps . Prior to keying in a school's enrollment data, the 
survey contractor staff subject the raw data to a considerable degree of 




Figure 4. HEGIS Processing by the Contractor 
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Figure 4 (cont'd) 
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editing. Basically, the data are checked for internal consistency and for 
similarity with the previous yearns data. Each school Is subjected to the 
same procedure; that is, HEGIS does not single out a sample of schools for 
more thorough review. 

The editing process centers around a so^alled "machine edit." The 
machine (a computer program) does the consistency and similarity checks, and 
staff members then follow up on any discrepancies uncovered by the program. 
Typically, staff members call or write to the person supplying the data 
about any discrepancies which cannot be resolved by inspection of the form. 
This correspondence, as well as the results of the editing procedure, are 
documented on the "Edit cover sheet," which is attached to the raw data 
forms « If correspondence with the school is undertaken, this is documented 
in "phone logs" or "edit memos," which are also attached to the data forms. 
These three documents are permanently kept with the raw forms. 

The consistency checks carried out by the program are of three types: 

a) Add checks, 

b) Presence/absence checks, and 

c) Tolerance checks. 

The add checks test whether enrollment figures actually add up. For 
example, the program checks that the number of undergraduates plus the num- 
ber of graduates equals the total enrollment. 

The presence /absence checks evaluate whether a school has reported data 
in categories that are inappropriate for that type of school (e.g., a two- 
year school that reports medical students), and whether different lines are 
filled in from one year to the next. 

Finally, the tolerance checks test whether the total enrollment is 
within a tolerance interval as compared to the previous yearns figure. 
These tolerance intervals are chosen arbitrarily by the director. 

Of these three types of checks, the add checks are the most involved 
and definitive. An absolute requirement for entry onto the file is that the 
school's data eventually pass the add checks. However, a school can fail 
some of the other types of checks and still be included (e.g., if the total 
enrollment is found to be "out of tolerance" due to errors in reporting the 
previous years' data or due to a different way of de ining enrollments, the 
unrevised figures may be entered onto the file.) But the enrollment figures 
that are reported must be internally consistent. 
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The add checks are applied to each page of the form, and the total page 
is tested against the sum of the detail pages* For each row in every page, 
the total for males and females separately must equal the sum of the racial/ 
ethnic breakdowns* For each column the following checks are done (see the 
Fall Enrollment Survey form in Figure 1, page ): 

a) Rows 2,3,4,5,6 « row 1 [Undergraduates] 

b) Rows 8,9 » row 7 [Unclassified] 

c) Rows 12,13 >« row 11 [Graduate students] 

d) Rows 16,17,18,19,20 - row 15 [Part-time undergraduates] 

e) Rows 22,23 » row 21 [part-time unclassified] 

f) Rows 26,27' row 25 [part-time graduate students] 

g) Rows 1,7,10,11* row 14 [full time students] 

h) Rows 15,21,24,25 » row 28 [Part-time students] 

i) Rows 14,28 " row 29 [grand total] 

As mentioned previously, the final add check compares each entry on the 
total page against the sum of the corresponding entries on the detail pages* 

If a school's data fail any of these add checks, the problem is resolved 
by a staff member* Certain types of simple, obvious errors are handled by 
the staff member* Other types of errors require contacting the school for 
clarification* 

Procedures used to contact the schools * Whenever the staff cannot 
resolve the problems uncovered by the machine edit, they contact the school 
by telephone or In writing* It Is not entirely clear how the staff decides 
between these two alternatives* If the school is called, the communication 
is documented on the "Phone Log" and summarized on the Edit Cover Sheet 
(Figure 5). If the communication is written, an appropriately filled out 
"Edit memo" is sent (Figure 6). This correspondence is also summarized on 
the Edit cover sheet. 

The categories and alternatives in the Edit memo provide some insight 
into the way discrepancies are resolved. The first three categories pertain 
to, problems with the add checks; categories 6, 8, and 9 pertain to tolerance 
checks; categories 4 and 10 refer to the presence/absence checks; and cate- 
gories 5 and 7 deal with the problem of nonresponse* 

As mentioned above, only problems that involve addition errors must be 
resolved* For presence/absence checks and tolerance checks, schools may 
(and do) respond with a comment or explanation rather than changing the 
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Figure 5 (cont'd) 
HEGIS XIII PHONE LOG 
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Figure 6 
EDIT MEMO FOR FECR SURVEY 



Nome of InsHfuHon WUuHon FICE Code Number 

Do\o in Question Becouse: 

Q 1 . Line(s) do not odd to the toto!($) in Column 13 on(i/or Column 14. 

n 2. Column(s)^ do not odd to the totol(s) on Line(s) , 

respectively^ 

□ 3. The sum of the fofal student's reported on fhe mojor field poges is higher/lower 
fhon fhe total figures on the summory poge, 

Line(s) 

Column(s) 

0 4. Students were/were not reported on Line{s) ^ of this yeor's form, but 

wer^were not reported in those some categories in foil ]977. Pleose revise 
this year's report or e^cploin the difference in the "Comments" section 
(item 13 below). 

D 5* Students arc reported on the total line(s) listed below but not broken down onto 
their detail lines. Pleose correct the designoted items, wit^ • brief explonotion, 
if necessary, in the "Comments" section (item 13 below)* 

a. Total reported on Line needs breokdown onto Lines 

b* Total reported Line needs breokdown onto Lines • 

c. Total reported on Line needs breokdown onto Lines ^ 

d. Total reported on Line needs breokdown onto Lines . 
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n 6, Your first-time freshmen enrollment for foil 1978 seems rother high/tow os 
compored to fall 1977. Pleose correct or confirm with o brief exptonotion, 
if necessory, in the "Comments" section (item 13 below)* 

CI 7. Unknown racial/ethnic dota reported for 1978* Pleose correct using one or a 
combination of the following: 

a. Distribute the unknown rociol/ethnic dota using some algorithm bosed on 
your institution's 1976 Fall Enrollment ond Compllonce Report response* 

b. Prorate the unknown doto bosed on the rociol/etlinic distribution of the 
known data, 

c. Any other method which would be oppropriote to your institution. 
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Figure 6 (Continued) 



□ 8. The ratio of full-time equivolent (FTE) enrollment (Column 15) seems rather 

high/low OS compared to the totol part-time heodcount (Port II) far 

Lj„g^5) ; please correct or confirm the designated items with o brief 

explanation, if necessary, in the "Comments" section (Item 13 below). 

n 9. Your totol enrollment for foil 1978 seems rother high/low as compored to 

foil 1977. Pleose explain briefly the reasons for »he change in the Comments 
section (item 13 belaw). 

n 10. Moior Fields 1204/1206, 1218, and 1400 should reflect only students at the 

first-professional level of enrollment. All other students should either be ploced 
in Moior Field 9000 (All Other) or be ploced in another oppropriote field. 
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figures themselves* However, the add checks and nonresponse problems must 
be resolved. As Is made explicit In the alternatives to category 7, this 
sometimes Involves Imputing certain data points so that all appropriate 
cells are filled and that the fllled**ln data add up properly* Category 7 
deals with nonresponse to the racial/ethnic categories within a line, while 
category 5 deals with nonresponse to detail lines within a column (e.g., 
unclassified total not broken down Into undergraduate and graduate). 

There are some Instances when problems other than the add checks require 
that the originally submitted data be changed. These problems deal with data 
entered in enrollment categories Inappropriate to that school. For example, 
a two--year college that reports medical school students would be required to 
move or otherwise modify these figures. This type of problem Is generally 
flagged as category 10 or category 4* However, certain types of category 4 
problems require only an explanation rather than data modification. For 
example, a two-year college reporting only freshmen one year and both fresh- 
men and sophomores the next would be contacted because they reported students 
In a previously unused category. The school could simply respond that the 
data are correct. 

Similarly, categories dealing with the tolerance checks may only elicit 
a comment or explanation from the school. The enrollment may change dras- 
tically from year to year because the method of computing the enrollment 
changes. If this Is the case, the school Is not required to use the same 
method as In previous years, or even correct previous years' figures If they 
are found to be In error. 

In summary, the consistency checks used by REGIS are much more stringent 
with respect to wlthln-year criteria than the between-year criteria. Data 
which do not pass the add checks are, in general, simply not entered onto 
the final HEGIS tape; however, data which do not pass the tolerance and some 
of the presence/absence checks are entered onto the file after the school 
has been contacted and permitted to explain the problem. 

In very rare instances, a school will simply not provide HEGIS with 
certain breakdowns, such as racial/ethnic data. If the staff Is unable to 
secure numbers from the school In question, the data which has been obtained 
will be entered onto the file; blanks (zeros) will be Inserted, denoting 
missing data, and the accompanying documentation will list each such school 
and describe the specific problem (Figure 7) . This Is done In preference to 
Imputing the missing data. 
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Figure 7 

HEGIS XIII 
FECR MASTER FILE STATUS 

The master file tape contains data for 3,170 institutions from a universe 
3,173 reporting units. Three institutions are not included because they have 
enrollments which are not applicable to the Fall Enrollment Survey for the 
following reasons: 

1) San Francisco Community Colleges Center System (FICE 004502) has 
only non-credit adult education. 

2) Center for Degree Studies, in Pennsylvania (FICE 0040A9) is com- 
prised solely of correspondence students. 

3) The Conmunity College of the Air Force (FICE 012308) does not 
offer classes. Students taking classes through this program are 
included in enrollment counts for the institutions in which they 
are actually taking classes. 

There are four institutions on the master file that contain arithmetic incon- 
sistencies in order to maintain the June 1979 published totals, 

1) Missouri Institute of Technology (FICE 002455), On the summary 
page, line 14, total full-time men (718 students) and total full- 
time women (22 students) are purposely omitted, 

2) Mount Olive College, in North Carolina (FICE 002949), On the 
suni-nary page, line 14, total full-time men (126 students) and 
total full-time women (199 students) are purposely omitted, 

3) Polytechnic Institute of New York (FICE 002796), The total 
columns contain an additional 1,995 students (1,863 men and 132 
women) not reflected in the detail columns. These additional 
students appear on the graduate students lines, 

4) * Baker Junior 'College, in Michigan, (FICE 004673), Line 16 

contains 1,356 additional students (50 men and 1,306 womzn). 

Six institutions provided total enrollments only, without breakdowns by specific 
year of study and racial/ethnic group, 

1) Golden Gate Baptist Seminary, in California, (FICE 001204), 

2) New Orleans Baptist Theological Seminary, (FICE 002019), 

3) Washington Theological Union, in Maryland, (FICE 010065), 

4) He/sivita Eastern Parkway Rabbinical Seminary, in Mcv York, 
(FICE 009633). 

5) Yeshivath Vizhitz, in New York, (FICE 013027), 

Q 6) Yeshivath Zichron Moshe, in Hew York, (FICE 011821), 
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Those institutions which did not provide racial/ethnic da ta nre: 

1) Southern Baptist Theological Seminary, in Kentucky, (FICE 00 9R2). 

2) Southeastern Baptist College, in Mississippi, (FICE 002435). • 

3) Saint Mary*s Sewinary-College, in Missouri, (FICE 002508). 

A) Saint Michaels Passionist Monastery, in Mev Jersey, (FICE 002637). 

5) University of the State of New York, External Degree Program, 
(FICE 011716). 

6) Roanoke Bible College, in North Carolina, (FICE 029088). 

7) Southeastern Baptist Theological Seminary, in North Carolina, 
(FICE 002963). 

8) American College, in Pennsylvania, (FICE 029018). 

9) Bob Jones University, in South Carolina, (FICE 003421)* 

10) Brooks Institute, in California, (FICE 001123). 

The U«S« Service Schools are not required to report race data, nor are they 
included in the OCR tables. If they do report race data, it is put on file 
unedited. ' 

Three institutions. University of Texas at El Paso (FICE 003661), Hampton 
Institute, in Virginia, (FICE 003714) and California College of Podiatric 
Medicine (FICE 001135), could not provide a breakdovm by year of study for 
graduate students. Two institutions, Bayamon Central University, Puerto Rico, 
(FICE 010015) and Hcbrev Union College Hew York Branch (FICE 004054), could 
not breakdown their unclassified students. 
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Imputation procedures * The processing specifications provide guide- 
lines for Imputation (Volume 2, pp« l-59ff). The central guideline Is that: 

data file must contain a 100 percent response by the Instltu** 
tlons and 100 percent In terms of survey data cells appropriate 
for that Institution* In most cases for the Fall Enrollment 
Survey, approval of the Imputation must be sought from the 
Institutions concerned (p* 1*^59)* 

This Is very obviously a stringent guideline In the sense that It places 
a great burden on the respondent* It, of course, assumes not only that every 
school In the universe Is capable of providing the Information, but also 
that these schools are all willing to do so* On the surface, It would seem 
unlikely that It Is possible for HEGIS to achieve such cooperation from the 

* 

entire universe of schools, especially In the years when the OCR data are 
collected* 

As a result, a considerable amount of Imputation Is actually taking 
place. Regrettably, the amount of Imputation being done Is not preserved on 
the HEGIS file using the Imputation fields* This Is because the term Impu- 
tation Is officially defined so that the category Is never used* According 
to the processing specs: "Imputation Implies that no Information was 
received formally or Informally from the Institution*' (Vol* 2, p* 1-62)* 
The definition goes on to distinguish between official Imputation and *'valld 
responses'' : 

Forms having data Imputed by NCES personnel shall be considered 
valid HEGIS XIII responses In any of the following cases: 

(1) Imputation was conducted via telephone with the Instltu*" 
tlon In question* 

(2) A copy of the Imputed questionnaire was mailed to the 
Institution, and concurrence was received by NCES* 

(3) A copy of the Imputed questionnaire was mailed to the 
Institution, revisions to the Imputation were received by 
NCES and subsequently applied to the Imputed form* 

(Vol* 2, p. 1-62) 

In other words, the Imputation Is done either by the school or with the 
Concurrence of the school* However, HEGIS refers to such Imputed data as 
"valid data*'; It Is the policy of HEGIS never to do anything which would 
meet their definition of *' Imputation*" 
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This Is best Illustrated by the fact that racial/ethnic categories are 
left blank In the few schools which do not cooperate with HBGIS. Contrary 
to the Impression given In the processing specs, the fields are not Imputed 
after staff have failed to obtain figures from these schools. In fact. It 
would be more realistic to eliminate the Imputation fields from the HEGIS 
file because as a matter of policy they will never be used (Pepin, personal 
communication, 1981)* Although the labelling of these data as "valid data'* 
rather than "Imputed data" does not alter the amount of error Introduced, It 
does make It difficult to determine the prevalence of these procedures. 

Potential Sources of Error 

Errors In the keypunching operations . No data are available to Indicate 
the level and type of keypunch error. The Requirements and Specifications 
Manual Indicates that the error rate will be less than S%« So we can assume 
that level as a maximum. With the further editing, It can be assumed that 
most, If not all, of these errors are discovered and corrected. 

Errors In the editing .op<%g_atlons . As a preliminary step, we redid the 
add checks on the HBQIS XIII fll&. MlDt surprisingly, these runs determined 
that all schools, save the few noted In the documentation, pass the add 
checks. (See Figure 7 for this listing.) Although this established that 
the editing procedures are "successful" In the sense that their goals are 
met, It does not establish that the data are error-free; clearly, the add 
checks constitute a necessary but not sufficient condition for error-free 
data. The "true" headcounts, presumably, have this property (e.g., assuming 
double majors are only counted as one person), but there are Infinitely many 
other configurations which also have this property. 

Errors Identified by Secondary Analyses 

Further analysis was needed to Identify the types of errors and the 
magnitude of these errors. The following sections on secondary analyses of 
the survey forms and edit materials and on the post-valldatlon study provide 
these details. 

To assess further the overall quality of the data turned In by the 
schools, and to evaluate the editing procedures used in HEGIS, we undertook 
a sample survey of HEGIS schools. Unlike the Peng post-validation study, 
which contacted the respondents themselves, this survey only examined 
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archival data. We secured a sample (N"200) of raw HEGIS forms and accom- 
panying edit materials from OCR« Along with the raw HEGIS forms, OCR 
retains the Edit cover sheet, the Phone log, and the Edit memo, If one has 
been sent« The HHGIS form Itself shows the history of corrections to the 
data, and the accompanying edit materials describe the sequence of events In 
the editing process. 

This survey was undertaken In order to address the following Issues: 

a) What Is the level of quality of the data being submitted? 

That Is, how frequently are the editing procedures 
actually needed? 

What proportion of schools turn In figures that do not 
pass the add checks? 

How often do schools list students In Incorrect cate- 
gories (e.g., third-year students In a two-year school) 
and how often do schools list students In programs they 
doa*t even offer (e.g., law school students listed In a 
four-year undergraduate school)? 

How well are the schools able to resolve students Into 
the specialized categories on the HEGIS form (e.g., sep- 
arating first-time freshmen from other first year and 
breaking down totals Into the racial/ethnic categories)? 

Do the tolerance checks Indicate that there are substan- 
tial fluctuations In total enrollments from year to year? 
If so. Is It due to changing definitions or mistakes made 
In previous years? 

b) How often are data Imputed? 

In response to calls or letters from HEGIS staff, how 
frequently do schools Impute data (as defined by the 
three criteria listed above)? Are some categories Imputed 
more often than others? 

c) Is the HEGIS system of editing capable of singling out those 
schools that do not use HEGIS definitions In computing 
enrollment figures? 

That Is, Is this system capable of finding these schools 
and getting them to use the HEGIS definitions? 

The purpose of Investigating the first Issue Is to determine the 
respondents* ability to do the task. Clearly, If a school Is unable or 
unwilling to provide accurate data, no amount of editing will ever eliminate 
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this as a source of error* The second Issue, highly related to the first, 
Is an attempt to roughly quantify the amount of Imputed data present on the 
HBGIS file. Any estimate that we construct from this survey will obviously 
be conservative, because this procedure Is only sensitive to Imputations 
made as a result of being contacted by HEGIS staff; Imputations made on the 
original form being submitted to HEGIS cannot be detected* 

The third Issue deals with the general problem that the HEGIS editing 
checks are for Internal consistency rather than Invalidity* That Is, the 
HEGIS checks will fall If Incorrect data are consistent; only If Invalid 
data are also Inconsistent will the checks be of value. 

Procedures* To Investigate this Issue, we originally planned to secure 
the HEGIS forms from the schools sampled by Feng* As discussed earlier In 
this report, an appreciable percentage of these schools said that they did 
not use NCES definitions, had trouble reporting first time freshmen, esti- 
mated enrollment figures, and so forth. Our plan was to see whether these - 
departures from the prescribed procedures were detected In the edits, and 
whether the edited data were closer to the reconstructed data provided In 
the post-valldatlon study. Regrettably, we were unable to secure the list 
of these schools and the post^alldatlon data tapes from the post^alldatlon 
contractor. Thus, we were unable to address this Issue. 

As an alternate plan, we conducted analyses of a sample of available 
Fall Enrollment Survey forms and edit materials. The schools to be Included 
In our survey were sampled from the HEGIS universe and chosen by the Lahlrl 
method (1950; Cochran, 1977) described earlier In the section on the selec-* 
tlon of Institutions for the Early Release Survey. The raw forms were 
obtained from OCR and duplicated for the 200 Institutions. These forms and 
the accompanying edit materials were then evaluated* 

In an attempt to summarize the Information In these materials, we 
devised the following categories of problems and scored each school In the 
sample according to presence/absence of these characteristics: 

(1) Date returned. In view of the problems schools had with the 
October 15 deadline, we noted when the forms were actually 
submitted In 1978, the first year In which the deadline was 
extended to November 15. 

(2) Math errors. If a school failed the add checks In either 
the manual or machine editing phase, HEGIS staff wrote "Hath 
error" on the edit cover sheet and described the problem. 
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(3) Impute Page* Occasionally a school only turned In a total 
(9999) page. If so, HE6IS generated an "all other" page 
(9000) and set the values of this page equal to the entries 
on the 9999 page. 

(4) Unknown students* If a school reported students whose race/ 
ethnicity were unknown or a non-HEGIS category (e.g., "mixed" 
Is reported In Hawaii), this was marked on the Edit cover 
sheet. 

(5) Prorate. If, during the course of the editing procedure, 
the school or the HE6IS staff prorated students, this was 
noted In either the phone log or the edit memo along with 
the method used for proration (e.g., use last year's figures 
or distribute a total equally among the relevant categories). 

(6) Inappropriate categories. If a school reported students In 
a category believed to be Inappropriate to that school, this 
was noted on the cover sheet. 

(7) Out of tolerance. If some figures were found to be out of 
tolerance In the machine edit, this was noted. 

(8) Form not equal to tape. We checked whether the total line 
on the total page matched the data on the tape. 

Results . The following tables report percentages of schools whose forms 
contained the above problems, broken down by public/private and two-year/ 
four-year. 

1* Date returned* Despite the more lenient deadline, fewer than half 
the schools were able to turn In their forms before 1 December. The follow- 
ing Indicates the percentage of schools who submitted their forms later than 
the end of November. 



Public 



Submitted After 
1 December 



Four--year 58% 
Two-year 44Z 



Private 

Four-year 48Z 
Two-year 60% 

2» Math errors * Math errors were much more common among four-year 
schools, as the following tables make clear. This may have been due to the 
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fact that more numbers had to be reported and there were many more add 
checks that could be failed* 



Table 28 

Percentage of Schools Having Math Errors 

Public Private 
Four-year Two-year Four-year Two-year 

No 22% 89% 54% 89% 

Yes 78% 11% 46% 11% 

3. Impute page > The converse of the situation with the math errors 
occurred with the impute page. A higher percentage of two-year schools had 
page 9000 (other) imputed* This happens when the school only turns in a 
total page, with no breakdowns* 

Table 29 

Percentage of Schools Having Page 9000 Imputed 

Public Private 
Four-year Two-year Four-year Two-year 

No 97% 82% 94% 83% 

Yes 3% 18% 6% 17% 

4 

4. Unknown students* There was a tendency for a higher percentage of 
four-year schools to report unknown students. 

Table 30 

Percentage of Schools Reporting Unknown Students 

Public Private 
Four-year Two-year Four-year Two-year 

No 75% 96% 83% 94% 

Yes 25% 4% 17% 6% 

Because the policy is to report complete data, some adjustment must be 
made in these cases* All of the schools with unknown students were contacted 



by the survey-contractor staffs and we attempted to categorize the methods 
used to adjust the original figures. Two methods occurred frequently enough 
to emerge as distinct strategies. They are: 

(1) Use some arbitrary method, such as distributing the unknown 
students equally across the HE6IS race/sex categories, or 

(2) Use some data-based method, such as distributing according 
to the known proportions, or last year's report. 

From some forms. It was not entirely clear what method had been used. The 
following tables give these breakdowns. 



Table 31 

Percentage of Schools Using an Arbitrary Method 
to Distribute Reported Unknown Students 

Public Private 
Four-year Two-year Four-year Two-year 

No 87% lOOZ 67Z 0% 

Yes 13% 0% 33% 100% 



Table 32 

Percentage of Schools Using a Data-Based Method 
to Distribute Unknown Students 

Public Private 
Four-year Two-year Four-year Two-year 

No 37% 50% 93% 100% 

Yes 63% 50% 7% 0% 



5. Prorate . Prorating Is also done when a school Is unable to break 
down total lines Into their component parts. The following table gives the 
percentages of schools that prorated during the editing process. Like the 
set of tables on unknown students, these percentages represent very conser- 
vative estimates; they only estimate the amount of prorating done during 
editing and the amount of schools who REPORTED unknown students. Since 
schools know oC the requirement for complete data, some unknown percentage 
Impute or prorate some of the data originally submitted to HE6IS. 
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Table 33 

Perceatage of Schools That Prorated During Editing § 

Public Private 
Four-year Two-year Four-year Two-year 

No 75% 84Z 88% 95% 

Yes 25% 16% 12% 5% 

As with the problem of unknown students, the same two methods emerged 
as the most common ways of dealing with the problem* A school that used an 
arbitrary method of prorating may, for example, agree to say that half of 
the unclassified students are undergraduates and half are graduates. HEGIS 
would then split the undassf ied totals in each column in half and enter 
these figures. Data-based methods include, for example, using the previous 
yearns proportions. 

Table 34 

Percentage of Schools That Used an 
Arbitrary Method to Prorate 

Public Private 
Four-year Two-year Four**year Two-year 

No 87% 67% 50% 0% 

Yes 13% 33% 50% 100% 



Table 35 

Percentage of Schools That Used a Data- 
Based Method to Prorate 

Public Private 
Four-year Two-year Four-year Two-year 

No 25% 67% 50% 100% 

Yes 75% 33% 50% 0% 



6, Inappropriate categories . Entering figures in inappropriate cate- 
gories was slightly more common in two-year rather than four-year schools, 



ERIC ll95 



possibly because more categories are inappropriate. A common error was to 
enter third-and-f ourth year students in a two-year school. Also, both four- 
and two-year undergraduate schools reported students in medical school, law 
school, dentistry, and veterinary medicine. This was rather puzzling, since 
these schools did not have any such programs. 



Table 36 

Percentage of Schools Reporting Students 
in Inappropriate Categories 

Public Private 
Four-year Two-year Four-year Two-year 

No 87% 81% 96% 100% 

Yes 13% 19% 4% 0% 

7. Out of tolerance . A higher proportion of four-year schools were 
found to be out of tolerance, but the reason for this is not clear to us. 
This statistic is a bit hard to interpret, because the tolerance intervals 
are themselves arbitrary and are a function of school size. Perhaps they 
are too narrow for larger schools. 



Table 37 

Percentage of Schools Found to be Out of Tolerance 

Public Private 
Four-year Two-year Four-year Two-year 

No 41% 88% 69% 83% 

Yes 59% 12% 31% 17% 

There were no instances in which figures were revised on the basis of 
this check, despite the fact that all schools were contacted and responded 
to the inquiry. Schools explained that the difference was due to any number 
of causes, such as 

(1) Enrollment changed due to changing financial situation 
and/or changes in college aged population. 

(2) Method of counting had changed. 
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(3) More (or fewer) students are counted due to a different 
policy. 



(4) Previous year's figures were wrong. 

Although this edit check does seem to be uncovering real sources of error, 
it is somewhat distressing that no action had been taken in response to the 
check. 

8. Form not equal to tape . In every instance we found that the final, 
revised HEGIS figures did, in fact, appear on the HEGIS tape. Thus, it is 
clear that these figures are being transcribed correctly. 

Discussion . From this survey we learned several things about the amount 
and type of editing done on HEGIS forms as well gaining an appreciation 
about the general quality of data being submi .. to KEGIS. Several features 
of the editing process emerged. 

First, it is very obvious that math errors i ^ very common, especially 
among 4-year schools. Schools seemed to have special difficulty passing the 
final add check, namely that the entries on the total page are the sums of 
the entries on the detail pages. The usual style of the editors was to use 
the 9000 page (all other) to absorb the discrepancy. Thus, an assumption 
used in dealing with math errors was that the total page and the detail 
pages referring to specific majors are correct. This, of course, is only 
one possibility; any combination of the pages could contain errors. 

This practice and assumption also was used in dealing with students 
entered in inappropriate major field categories. Frequently, the action 
taken is to move these students onto the 9000 page, leaving the remaining 
detail and total pages intact. And, by definition, the practice of imputing 
page 9000 when a school only turned in a total page makes the same assump- 
tion. Thus, the 9000 page appears to be functioning as a "dumping ground" 
for problems associated with inconsistencies and among the detail, all 
other, and total pages. Although the percentage of schools whose total 
enrollment was found to be out of tolerance is not of great meaning because 
the tolerance intervals themselves are arbitrary, the responses from the 
schools (contained on the Edit Memo) are meaningful. Their explanations of 
year-to-year fluctuations do shed some light on the problem of changing 
definitions of enrollment categories. HEGIS definitions are such that 
almost any method a school chooses to use is accepted. According to the 
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Edit memo, this includes any method used previously by the school, as well 
as "any other" method appropriate to the school* Some schools that were 
contacted responded by stating some real problem, such as use of a different 
definition or procedure (e«g«, computer vs« manual) or even that the previ- 
ous years* figures were wrong. Because the HE6IS editing system has not had 
a mechanism for correcting year-*to^ear inconsistencies, these sources of 
error are present in the final figures* 

Finally, the results of this survey make it very clear that, in many 
cases, the HEGIS forms ask schools for more detailed information than they 
are capable of providing with available resources* The detailed breakdowns 
required in the OCR years, as well as certain breakdowns on each major field 
page, such as first- time freshmen and other first year, were especially 
difficult* Within a page, a school that could not resolve a total figure 
into its component parts sometimes left the lines blank* This would cause 
a failure of the add check and subsequent contacting of the school* At 
that point, a school was required to supply or impute these lines. From the 
documentation in the edit materials, it appeared that a frequent scenario 
was that a staff member might suggest a certain imputation strategy (e*g*, 
half of freshmen are first- time freshmen) and see if a school would agree 
with that formula or suggest another* For inconsistencies across pages, it 
appeared that the most frequent suggestion was to ask if the "extra*' stu- 
dents belonged on the page for the category 9000* 

In other words, the fact that HEGIS meets its goal of 100% response 
rate from all schools in the universe and 100% complete forms from these 
schools does not accurately represent the overall quality of these data* In 
reality, a substantial amount of uncontrolled and undocumented imputation is 
done, and it appears that a substantial proportion of schools are at least 
partially unable to supply such detailed enrollment figures* This survey 
suggests that schools have an especially hard time resolving freshmen into 
first time and other first year and resolving unclassif ieds into graduates 
and undergraduates* Also, page 9000 appears to be a dumping ground for 
assorted problems with the major field categories* We are somewhat puzzled 
as to why HEGIS has adopted the policy of not using imputation flags as a 
way of expressing to the user the relative degree of quality of the data* 
It would be more useful to secondary analysts if the imputation fields were 
used to denote any datapoints imputed by the school during editing. As with 
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the post-validation study, we believe that grand totals are apt to be more 
accurate than individual breakdowns, and that some categories are more sub-* 
ject to error than others* 

Errors Identified by the Post-Validation Study 

The Peng (1979) post-validation study of the 1977-78 Fall Enrollment 
survey provides another source of data on the accuracy of the HEGIS data 
collection and editing operations. A sample of 120 institutions was 
selected for participation in the study. Only four institutions refused 
or were unable to cooperate* Substitutions were made for three of the 
four; the fourth institution, selected because of its continued refusal to 
participate in the Fall Enrollment survey, did not receive a substitution. 
Onsite interviews were conducted with institution personnel responsible for 
or involved in the preparation of the HEGIS report. Using information from 
internal and State reports, summary sheets, worksheets, and other written 
documents, data on enrollment as of 15 October 1977 were reconstructed. 
These data were compared with the published data. Discrepancies were 
resolved through follotf-up telephone calls. It should be noted that about 
IS percent of the institutions failed to provide documents other than the 
original HEGIS reports. These were assumed to be accurate since no other 
verification was possible. 

The differences between the reconstructed and the NCES published data 
were computed for each of the 29 line items on the form (e.g., first-time 
freshmen). These differences were displayed in two forms: 

• net differences, obtained as the sum of the actual differ- 
ences between the reconstructed and the NCES data, and 

• gross differences, obtained as the sum of the absolute value 
of the differences. 

Table 38 provides the net differences between the reconstructed fall 
enrollment data and the published NCES data for each line item. Positive 
numbers indicate that the published data were over-reported, and negative 
numbers indicate that they were under-reported. For example, among full- 
time students, first-time freshmen were over-reported by 26,598, while other 
first-year students were under-reported by 32,696. Table 39 shows the net 
differences as a percentage of the published data. The results reveal that 
the greatest differences (or errors) occurred for other first-year students 




Table 38 

Net Differences Between NCES' Published Data and the "Most Accurate" Data 1/ 



Student level 2/ 


Total 
1 nsti uULions 


Public 


Private 


Four-year 


Two-year 


Four-year 


Two- vear 


I. Full-time students 












01 Undergraduates, total 


-29 » 5 66 


- 201 


13,089 


-44,818 


2,373 


02 First-time freshmen 


26»598 


1,063 


27,896 


- 1,911 


- 451 


03 Other first-year 


-32,696 


- 782 


-31,710 


237 


- 441 


04 Second-year 


4,256 


446 


- 1,007 


1,303 


3,514 


05 Third-year 


- 2,332 


- 1,397 




- 935 




06 Fourth -year and 












beyond 


. 466 


- 701 




235 




07 Unclassified students, 












total 


- 4,716 


87 


- 6,198 


1,813 


- 245 


08 Undergraduate level 


- 3,206 


60 


- 5,505 


2,484 


- 245 


09 Postbaccal aureate 












level 


- 599 


- 147 




- 452 




10 First-professional 












students 


- 729 


235 




OCA 




11 Graduate students^ 












lotai 




1,632 




C71 

D/1 




12 First-year 


733 


39 




694 




13 Beyond first year 


1 o 

IB 


18 




0 




14 Total full-time 












students 


10,939 


1,573 


8,742 


468 


156 


II. Part-time students 












15 Undergraduates, total 


33,412 3/ 


- 369 


55,989 3/ -22,039 


- 167 


16 First-time freshmen 


-16,436 ~ 


760 


-16,095 


- 941 


- 160 


17 Other first-year 


-39,813 


84 


-30,284 


- 9,774 


160 


18 Second-year 


- 3,698 


326 


- 3,554 


- 304 


- 167 


19 Third-year 


- 1,685 


- 294 




- 1,390 




20 Fourth year and 












beyond 


- 8,667 


- 130 




- 8,537 




21 Unclassified students. 












total 


-50,073 


19 


-72,875 


22,582 


200 


22 Undergraduate level 


-46,375 


56 


-70,144 


23,513 


200 


23 Postbaccal aureate 


2,637 


- 253 




2,890 


— 


24 First professional 








505 




students 


505 


0 








- 3 837 


- 2,822 




- 1,015 




26 First-year 


- 781 


155 




- 936 




27 Beyond first year 


- 1,471 


- 1,393 




79 




28 Total part-time students 


-18,763 


- 1,980 


-16,849 


33 


33 


29 Grand total, a11 students 


- 7,824 


- 406 


- 8,107 


501 


189 



y Net differences are defined as the sum of the actual differences between the 
published and the reconstructed data. The sign indicates that the published 
figure was smaller than the reconstructed one 

2/ Details by type of institutions may not exactly add up to total due to rounding 
errors 

y Some institutions reported only totals in the HE6IS report, and the totals were 
overestimated 
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Table 39 

* 

Net Differences as a Percent of the Published Data 1/ 



Student level 



I. Full-time students 

01 Undergraduates, total 

02 First-time freshmen 

03 Other first-year 

04 Second-year 

05 Third-year 

06 Fourth-year and beyond 
07 Unclassified students, 

total 

08 Undergraduate level 

09 Postbaccal aureate 
level 

10 First-professional 
students 

11 Graduate students. 
Total 

12 First-year. 

13 Beyond first year 

14 Total full-time 
students 

II. Part-time students 

15 Undergraduates, total 

16 First-time freshmen 

17 Other first-year 

18 Second-year 

19 Third-year 

20 Fourth year and beyond 
21 Unclassified students, 

total 

22 Undergraduate level 

23 Postbaccal aureate 

24 First professional 

students 

25 Graduate students, total 

26 First-year 

27 Beyond first year 

28 Total part-time students 

29 Grand total, all students 



Total 
institutions 


Public 


Four -year 


Two-year 


- .49% 






1.61 


.16 


4.89 


- 3.72 






.28 


.06 


- .25 


- .22 


1 G 




- .05 


- .10 




- 2.30 


- .12 


- 6.14 


- 1,97 


1 7 
• 1/ 




- 1.40 


- .40 




- .32 


.29 


— 


.44 


.49 




.27 


.02 




.01 


.01 




.16 


.04 


.56 


1.29 


- .06 


3.26 


- 2.66 


1.28 


- 3.06 


_ 4.67 


.07 


- 4.53 


- .63 


.26 


- .85 


- .91 


- .22 




- 3.70 


- .07 




- 4.90 


.01 


-13.93 


- 5.41 


.03 


-13.41 


1.59 


- .21 




2.71 


0 




- .64 


- .63 




- .22 


.05 




- .59 


- .85 




- .44 


- .14 


- .75 


- .07 


- .01 


- .21 



Private 



Four-year I Two-year 



3.483} 
.55 
.27 
.39 
.32 
.09 

5.64 
9.48 

7.63 

.64 

.36 
.97 
0 

.03 



-10.70 

- 4.06 
-20.97 

- .79 

- 2.92 
-17.11 

12.34 
17.37 
6.06 

2.88 

- .65 

• 1.32 

• .09 
.01 
.02 



1.89% 

- .74 

- 2.79 
7.40 



816.67 
816.67 



.12 



.67 
1.77 
2.23 
1.99 



12.91 
12.91 



1/ The percentage was computed as follows: 
J J 

/ 2 w.p. . 100, where w. is the weight, x. is the actual 

difference, p i%the published enrollment 
figure for the i"*" institution, and J the 
number of institutions in the group. 



.13 
.12 



Z w.x. 
i«l ^ ^ 
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and for unclassified students* Furthermore, although the percentage of 
errors for the grand total was small, the percentage of error for the more 
detailed categories was much higher* "Thus, most of the errors seemed to be 
caused by classification problems rather than uncertainty about the total 
enrollment" (Peng, 1979, p* 2-19). 

Table 40 displays the gross differences between the two data sets, 
showing the total magnitude of error (both over- and under-estimation) • In 
Table 41 can be found the gross differences as a percent of the published 
data* As with the data on the net differences, this shows that the greatest 
errors occurred with first-time freshmen, other first-^year students, and 
unclassified students* 
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Table 40 

Gross Differences Between NCES' Published Data and the Reconstructed Data 1/ 



Student level 



Total 
institutions 



Public 



Four-year 



Two-year 



Private 



Four-year 



Two-year 



I. Full-time students 

01 Undergraduates, total 

02 First-time freshmen 

03 Other first-year 

04 Second-year 

05 Third-year 

06 Fourth-year and beyond 
07 Unclassified students, 

total 

08 Undergraduate level 

09 Postbaccal aureate 

level 

10 First-professional 

students 

11 Graduate students. 

Total 

12 First-year 

13 Beyond first year 

14 Total full-time 

students 

II. Part-time students 

15 Undergraduates, total 

16 First-time freshmen 

17 Other first-year 

18 Second-year 

19 Third-year 

20 Fourth year and beyond 
21 Unclassified students, 

total 

22 Undergraduate level 

23 Postbaccal aureate 

24 First professional 

students 

25 Graduate students, total 

26 First-year 

27 Beyond first year 

28 Total part-time students 

29 Grand total, all students 



72,200 
34,802 
40,516 
9,608 
2,423 
2,466 

10,769 
10,979 

796 

3,089 

2,844 
1,065 
308 

19,144 



88,347 
27,938 
48,813 
11,189 
2,383 
X0,354 

127,552 
128,376 
6,082 

1,069 
7,614 
1,423 
4,917 
65,710 
57,252 



299 
1,063 

909 

507 
1,397 

701 

146 
60 

179 

235 

1,842 
39 
308 

1,705 



2,102 
760 
183 
388 
736 
293 

3,507 
670 
3,193 

0 

6,268 
155 
4,838 
7,238 
5,795 



22,749 
29,970 
35,649 
4,210 



6,770 
7,463 



14,688 



63,047 
25,827 
34,757 
9,173 



101,081 
103,811 



57,050 
48,971 



46,779 
2,409 
2,209 
1,377 
1,026 
1,765 

3,609 
3,212 

616 

2,853 

1,002 
1,025 
0 

2,596 



23,030 
1,190 

13,713 
1,461 
1,647 

10,060 

22,764 
23,695 
2,890 

1,069 
1,346 
1,268 
79 
1,388 
2,297 



2,373 
1,359 
1,750 
3,514 



245 
245 



156 



167 
160 
160 
167 



200 
200 



33 
189 



y Gross differences are defined as the sum of absolute differences between the 
~ published and the reconstructed data. . 
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Table 41 



Gross Differences as Percentage of the Published Data 1/ 



Student level 


Total ' 
institutions 


Public 


Private 


r uu 1 — jrc ar 


1 wu— jfCar 


r our^year 


1 wo-year 


I* Full-time students 

* * f M 1 1 V till w V V M^a w 1 I W 












01 Undergraduates, total 


1.19% 






3 Ad^ 




02 First-time freshmen 


2,11 


.16 


9 • bU 


70 


9 97 
b • bO 


03 Other f irst-vear 


4.61 


30 


7 


• uu 


11 07 
XX • u/ 


04 Second-year 


.63 


07 


1 Od 




7 AH 


05 Third-year 


.23 


.18 




.65 

• uu 




06 Fourth-year and beyond 


.26 


1 0 




3A 




07 Unclassified students, 












total 


5.24 


PO 


fi 71 
U • / X 


11.23 

XX • bw 


A16 67 
0x0 •0/ 


08 Undergraduate level 


6.76 


17 


7 dO 


12 26 

Xb • bU 


816 67 
ox u • u / 


09 Postbaccal aureate 












level 


1.85 


• HO 




10 dO 
xu • tu 




10 First-professional 












students 


1.35 


.29 


— — 


1.93 


— — 


11 Graduate students, 












Total 


.55 


.55 




.54 




12 First-year 


.40 


02 




1.43 




13 Beyond first year 


.12 


99 




0 




14 Total full-time 












students 


.27 


0^ 


Qd 


1 f1 


1 9 
• lb 


II* Part-time students 












15 Undergraduates, total 


3.42 




3 fi7 


11 1ft 
11 • 10 


67 
• 0/ 


16 First-time freshmen 


4.52 


1 28 

X • bO 


d Q1 

H • 7X 


5.13 


1.77 
1 • / / 


17 Other f irst-vear 


5.73 


Id 


<i 90 

3 • bU 


9Q d3 

b? • HO 


9 P3 

b • CO 


18 Second-year 


1.90 


.31 


2.20 

b • b W 


3.79 


1.99 

X • ? 7 


19 Third-year 


1.29 


fid 




3 d5 

w • H3 




20 Fourth year and beyond 


4.26 


• xo 




20 16 
bU* 10 




21 Unclassified students* 

H %^ 1 1 1 ^mmm mm w w w ^m^A mm w m ^0 ^» ■ i w mm m 












total 


12.47 


1.11 

X • X X 


19.32 


12.34 


12.91 


22 Undergraduate level 


14.97 


34 


19.84 


17.50 

X/ • 


12.91 

Xb • 7 X 


23 Postbaccal aureate 


3.68 


2.71 




6.06 




24 First professional 












students 


5.74 


0 




6.10 




29 Graduate students, total 


1.26 


1.41 




.87 




26 First-year 


.40 


.05 




1.78 




27 Beyond first year 


1.98 


2.95 




.09 




28 Total part-time students 


1.55 


.52 


2.55 


.25 


■ .13 


29 Grand total, all students 


.51 


.11 


1.28 


.10 


.12 



1/ The percentage was computed as follows: 



J J 

E w.d. / E w^p^ . 100, where w. is the weight, d. is the absolute value 
i=l i=l of the difference, p is the published enrollment 

figure for the. i institution, and J, the number 
of institutions in the group. 

o 
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VII, Data Analysis and Interpretation 



Description of the Data Presentations 

Data from the Fall Enrollment survey are presented in several different 
reports* The basic data and summary tables appear in the annual report 
entitled Fall enrollment in higher education * A brief section at the begin- 
ning highlights the enrollment statistics , showing total and percentage 
changes as compared with previous years* Following the brief discussion, 
summary tables are presented* These include data on individual schools* 
None of these tables display error rates* The appendices provide a one-page 
description of the data collection and editing and a copy of the question- 
naire* 

In addition to the above report, NCES prepares a brief paper on the 
results of the early release survey* This paper is titled Early release; 
Fall enrollment in colleges and universities; Preliminary estimates * The 
Early Release reports began to be published in Fall 1980* The report con- 
sists of a one-page suomiary followed by several pages of tables* The 
methodology section at the end of the report describes the sampling method 
and the potential sources of error, including a table of the estimated 
coefficients of variation* 

Finally, OCR prepares a report based on analyses of the Fall Enrollment 
data "designed to assist OCR^s regional and headquarters staff in their 
selection (or targeting) of institutions of higher education for compliance 
reviews" (Office for Civil Rights, 1979)* The two major issues addressed by 
these analyses were; 

(1) excess minority attrition in four-year undergraduate insti- 
tutions (calculated by comparing the 1976-77 freshman 
minority enrollment in an institution with the 1978-79 
Junior enrollment within the same institution and by com- 
paring the 1976-77 sophomore enrollment with the 1978-79 
senior enrollment) 

(2) underrepresentation of minorities and females enrolled in 
professional schools (i*e*, medicine, dentistry, law, and 
veterinary medicine)* 

The report presents a ranking of the institutions for each component of the 
two compliance issues* The report provides no description of the data col- 
lection procedures and no indication of possible errors. 
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Potential Sources of Error 

None of the reports discuss nonsampllng error # This leaves the reader 
with the Impression that the data are error-free* As has been shown In this 
present report, the data are not error-free* Some discussion of these 
errors should appear In the reports* 

The report on Fall enrollment In higher education presents data on dif- 
ferences Involving changes over time* Unfortunately , no checks or tests are 
performed* Thus, some of these statements discuss changes which are prob- 
ably not statistically significant* 

The Early Release report Identifies two sources of error* First, 
enrollments were estimated for new Institutions that had been added since 
the previous year* Previous years' average enrollments were used to esti- 
mate the total enrollment for these Institutions* In addition, sampling 
error was discussed followed by a presentation of the sampling error as the 
variation among estimates from all possible samples* The report then states 
"we are approximately 95 percent confident that the^ctual enrollment fig- 
ures which would be obtained from all 3,190 Institutions are within two 
standard errors of the figures shown In the Summary Tables'' (National Center 
for Education Statistics, 1980)* 

The OCR Targe tlng^ Analyses report does present the data on excess 
minority attrition based on tests of statistical significance* "Only Insti- 
tutions that were detected as having a statistically significant different 
racial enrollment distribution (with a 95 percent level of confidence) were 
retained and Included In the final set of targeting reports***" (Office for 
Civil Rights, 1979, p* B-2)* These were not described, however* The data 
on enrollment in professional schools was basically enumeratlve "since no 
statistical test of significance was performed on these data*" In neither 
case Is there evidence to Indicate that differences In the rankings of 
Institutions were significant* 
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VIII. Conclusions and Recommendations 



Overvie w 

The present report provided a process or error profile of the Fall 
Enrollment Survey within the Higher Education General Information Survey 
(HEGIS). It documents sources of error in the survey and identifies poten- 
tial sources of error. In addition, it can serve as a model for future 
efforts. The following paragraphs summarize the findings and recommend 
future efforts. 

Sources of Error 

Major steps in the survey were identified. Information was then assem- 
bled to describe the processes undertaken in each step and to document the 
sources and magnitude of errors associated with each step. 

Step 1? Survey objectives. The HEGIS, as an entire package, appears 
to be meeting the information needs of numerous federal and state agencies, 
associations of higher education institutions, and research organizations. 
Furthermore, a process exists for modifying and updating the survey objec- 
tives to meet information needs more closely. 

Quantifying the "error" associated arising from a mismatch of informa- 
tion needs and survey objectives is impossible without detailed documenta- 
tion on the matches ahd mismatches* Ue can identify some problem ateas 
where such mismatches can be reduced or eliminated. 

• Timeliness of HEGIS data is seen as a major problem. The 
Early Release Study addresses this problem, but the issue of 
data availability remains* 

• More data are wanted on student characteristics and financial 
aid. As shown in our analysis of the data analysis and pro- 
cessing operations, many institutions are unable or unwilling 
to provide the data currently requested* Additional data 
demands on all the institutions would increase the burden and 
possibly reduce the accuracy. If such data are needed, they 
should be gathered in special samples of the HEGIS universe. 

• Institutions are concerned about using the HEGIS data for 
comparison purposes. This was discussed primarily in terms 
of the financial data. It is, however, applicable to the 
enrollment data — given the lack of timeliness in the 
responses, the lack of similar definitions or interpretations 
of the given definitions, and the lack of appropriate detail. 
The major use of institutional comparisons with the Fall 
Enrollment data appears in the OCR analyses. 
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Step 2; Samplings The HEGIS Pall Enrollment Survey Involves the unl-* 
verse of Institutions of higher education within the United States and its 
outlying areas* The errors in the frame are small, less than one percent of 
the universe* The errors result from undercoverage of certain institutions 
(i«e«« time lag between receipt of accreditation and entrance into the 
frame, refusal to cooperate), from overcoverage of certain institutions 
(i«e«, time lag between loss of accreditation and removal from the frame, 
inclusion of vocational postsecondary institutions), and from misclassifi- 
cation* The effect of these frame errors on the enrollment figures is 
extremely small, probably less than «1 percent* 

Step 3; Measurement instruments* The Fall Enrollment Survey uses 
alternate forms for alternate years of the survey* During the years when 
data are collected for OCR, categories for race/ethnicity and type of course 
are added to those of degree credit versus non-degree credit, resident ver- 
sus extension student, grade level, full-time versus part-time student, and 
sex* The following list indicates the sources of error that were discussed* 

# Uncertainty exists among the respondents as to the focus of 
the survey—the peak enrollment, the total number of students 
ever enrolled, the number of students currently enrolled, the 
students who completed the fall term, or the total number of 
students after the drop/add period* This uncertainty leads 
to inconsistencies in reporting among institutions* For 
example, the post-validation study found that about 56 per- 
cent of the institutions deleted dropouts from their reports, 
while the remaining 44 percent included them* 

# Almost 25 percent of the institutions reported that they did 
not follow the HEGIS definitions for student levels, citing 
such problems as inability to distinguish first-time freshmen 
from other first year students, difficulty in classifying 
transfer students* 

# Institutions tended to overreport full"*time students and to 
underreport part-time students* The resulting error was less 
than one percent* 

# Another problem involved that of interpreting and applying 
one of three definitions for the full-time equivalent (FTE) 
counts* No data are collected on the specific method used by 
each institution* 

The chapter concluded with some suggestions for improvements in the wording 
and format of the questionnaire* 



-96115 



Step 4; Data collect Ion > The data collection effort involves several 
different parties* NCES distributes the questionnaires to the institution; 
in most cases this is done through a state coordinator* Institutions com- 
pile the information through computerized systems (39*7 percent), through 
manual operations (30*9 percent), through aggregation of department reports 
(•4 percent) and through partly computerized and partly manual operations 
(16*0 percent)* The responses are returned to NCES and then transmitted to 
the outside contractor for processing* Some potential sources of error 
include the response problems described in the section on measurement 
instruments, as well as the following: 

• The post-validation study found that about 13 percent or the 
institutions had to estimate the enrollment counts* Informa-* 
tion as to which institutions estimate enrollment counts and 
what methods are used is not gathered as part of the survey* 

• Institutions acknowledged that the following errors occurred: 
misclassif ication (23 percent), multiple counts (23 percent), 
omission of late registrations (38 percent), and inclusion of 
late dropouts (44 percent) 

• Institutions with computerized systems provided more accurate 
data than those with other systems, according to the results 
of the post-validation study* 

The discussion below on the data preparation identifies further sources of 
error related to both the measurement instruments and to the data collection* 

Step 5: Data preparation * The coding, editing, and imputation proce- 
dures are handled by an outside contractor following the operations outlined 
by NCES in the Requirements and Specifications Manual * Potential sources of 
error were identified* 

• At least 20 percent of the institutions were unable to com- 
plete the forms without including math errors, imputing or 
prorating to indicate category breakdowns, or reporting stu-* 
dents in inappropriate categories* In addition, a similar 
percentage of institutions failed the tolerance checks* None 
of these problems are recorded on the data tapes or in the 
accompanying documentation* 

• Data from the post-validation study indicate a small percent- 
age of error (less than one percent) for the total enrollment 
counts* Much higher level of error occur in the detailed 
categories* 

These data suggest that a substantial percentage of the institutions are 
unable or unwilling to provide detailed category breakdowns* Because of the 
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HEGIS policy to have lOOZ response, these institutions are forced to esti- 
mate, prorate, and impute enrollment counts. Since none of this activity is 
recorded on the data tapes, one is left with the impression that no imputa-* 
tion occurred* 

Step 6: Data analysis and interpretation ^ Three major reports are 
prepared using the Fall Enrollment data: (1) Fall enrollment in higher edu- 
cation, (2) Early release , and (3) OCR's Targeting analyses > None of these 
reports includes any discussion of nonsampling error, leaving the reader to 
assume that the data are error-free « 



ERIC 



117 

-98- 



References 



American Council on Education, Center for Research and Development in Higher 
Education at Berkeley, Education Commission of the States, National Cen- 
ter for Higher Education Management Systems at Western Inter-State Com- 
mission on Higher Education, & State Higher Education Executive Officers 
Association* Eighth Annual Conference on Higher Education General 
Information Survey (HEGIS) * Washington, D»C»: American Council on Edu- 
cation, 1972* 

Andrew, L* D* Analysis of uses of HEGIS data * Blacksburg, VA: Virginia 
Polytechnic Institute and State University, 1980« 

Berg, F« Personal communication, 1982« 

Brooks, C« A«, & Bailar, B« A* An error profile: Employment as measured by 
the Current Population Survey (Office of Federal Statistical Policy and 
Standards, Statistical Policy Working Paper 3)« Washington, D«C«: U«S« 
Department of Commerce, 1978« 

Brown, K* G*, Padgett, D# W», & Embry, L* R* Oses of national data systems 
by institutional researchers: Implications for the 1980^ s# Twentieth 
Annual Forum of the Association for Institutional Research, Atlanta, 1980« 

Cochran, W* Survey Sampling (3rd edO* New York: Wiley, 1977* 

California State Department of Education^ Directory of California private 
postsecondary educational institutions and public and private institu- 
tions "Approved for Veterans," 1978^ Sacramento, CA«: Author, 1978^ 

Drews, T* H* HEGIS: A survey program becomes a system* Seventh annual con- 
ference on Higher Education General Information Survey (HEGIS) ♦ Washing- 
ton, D«C«: National Center for Education Statistics, 1971« 

Hyatt, J* A*, & Dickmeyer, N» Joint study group on the utility of HEGIS 
finance data for institutional and higher education sector comparisons 
(Draft Report)* Washington, D*C*: National Center for Education Sta- 
tistics, American Council on Education, National Association of College 
and University Business Officers, 1980« 

Lahiri, D* B« A method of sample selection providing unbiased ratio 

estimates* Bulletin of the International Statistical Institutes , 1951, 
33, 133-140*^ ' 

National Center for Education Statistics* Early release: Fall enrollment in 
colleges and universities, 1980: Preliminary estimates * Washington, 
D*C«: Author, 1980« 

National Center for Education Statistics* Report of the eleventh annual 
conference on the Higher Education General Information Survey (HEGIS) * 
Washington, D*C*: U«S* Department of Health, Education, and Welfare/ 
Education Division, 1975« 



-99- 118 



National Center for Education Statistics, Western Inter-state Commission on 
Higher Education, & American Council on Education. Seventh annual con- 
ference on Higher Education General Information Survey (HEGIS) . Washing- 
ton, D.C.: National Center for Education Statistics, 1971. 

Office of Civil Rights, & Value Engineering Company. Targeting analyses in 
institutions of higher education based on excess minority attrition in 
undergraduate institutions and the underrepresentation of minorities and 
females in professional schools. Washington, D.C.: Authors, 1979. 

Feng, S. HEGIS post-survey validation study (2 volsO« Rockville, MD: 
Westat, 1979. 



Pepin, A. J. Fall enrollment in higher education 1978. 
National Center for Education Statistics, 1979. 



Washington, D.C.: 



Pepin, A. J. Personal communication, 1981. 

Peterson, R. J* , & Davis, G. C. Education directory, colleges & universities 
1979-1980 . Washington, D.C.: National Center for Education Statistics, 
1980. 

Podolsky, A. HEGIS XIII 1978-1979 requirements and specifications manual 
(2 vols.), Washington^ D.C.: National Center for Education Statistics, 
1979, 

Roark, A. C. Washington's **most effective** lobbyist for higher education. 
The Chronicle of Higher Education , October 6, 1980, p. 3. 

Russ-Ef t, D. F* Validity and reliability in survey research (SAGE Technical 
Report No. 15). Palo Alto, CA: American Institutes for Research) 1980. 

Topping, J. Evaluation of the lEP costing procedures; A pilot study of six 
major research universities . Boulder, CO: National Center for Higher 
Education Management Systems, 1979. 



1X9 



ERIC 



-100- 



APPENDIX A: 



Background Information on HBGIS 



Needs for Information on Higher Education 

. Institutions of higher education are an Important component within the 
American educational system « From the earliest reports on the condition of 
education, certain Information about these Institutions was Identified as 
critical: 



The names and locations of these Institutions 

The names of their presidents 

The dates Institutions were established 

Their religious affiliations 

The number of Instructors on the staff 

The number of students enrolled 
Level of these students 
Numbers of males and females 

The tuition per month and the board per month at each 
Institution 

The number of volumes In the library 



A detailed version of these Information needs appears In the Report on the 
eighth annual conference on Higher Education General Information Survey 



Over the years the Information needs on Institutions of higher educa- 
tion have Increased. The following are some examples at the federal level* 
The National Science Foundation has used Information on the enrollment counts 
for advanced degrees for planning support programs. The Accreditation and 
Institutional Eligibility Staff of the Bureau of Higher Education needs 
Information on Institutional characteristics to determine eligibility for 
participation In federal programs. The Department of Labor needs data on 
tuition for computing Indexes of education cost and cost of living. They 
also need data on enrollments and degrees earned for preparing manpower 
reports. . , .> 



(1972). 
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State agencies, research organizations, and associations of higher edu- 
cation institutions also need data regarding higher education* These organi- 
zations need information on enrollments, faculties, finances, and staff to 
develop policies and recommendations* For example, the Mid-West Advisory 
Commission on Higher Education needed data on the residence and migration of 
college students to formulate a uniform policy for out-of-state students* 

Purpose of HEGIS 

The original purpose for HEGIS was to acquire and disseminate, to agen- 
cies within the Federal government and to the higher education community, 
iLore meaningful statistics on the operations of higher education (Drews, 
1971)* The meaningfulness of these statistics derived from the content as 
well as the format of the data* 

Having more meaningful statistics was not the only purpose for HEGIS* 
As mentioned above, the response burden on institutions had been growing 
steadily* A secondary purpose for HEGIS was to reduce this burden* Related 
to the reduction in the response burden was the goal of attaining some con- 
sistency (across surveys and across years) in the data collection effort* 

Method for Developing and Elaborating the Purpose of HEGIS 

The HEGIS package was developed at the request of the higher education 
community (Drews, 1971)* This community consists of the institutions of 
higher education, the various voluntary organizations within these institu- 
tions, professional groups within the institutions, and the federal, state, 
and local governmental agencies involved with or assisting higher education* 
Indeed, representatives of those various groups gathered at the Office of 
Education in the early part of 1966 to assist in developing HEGIS* 

The higher education community continues to advise NOBS in the planning 
for HEGIS* This is accomplished through the annual HEGIS planning confer- 
ence* An excellent example of the recommendations made by the higher educa- 
tion community appear in the Final Report of the seventh annual conference 
on Higher Education General Information Survey (1971)* 

Hatch between the Inforraation Needs and the Purpose of HEGIS 

One potential source of error arises from the match or mismatch between 
the information needs and the purposes of the survey* There is a close match 
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between the Information needs and the purposes of HEGIS* The primary purpose 
of acquiring and disseminating meaningful statistics on higher education 
meets the needs of numerous federal and state agencies, associations of 
higher education Institutions, and research organizations* Evidence for this 
statement comes from the report by Andrew (1980) titled Analysis of uses of 
HEGIS data* The report examined the questions of who uses the HEGIS data 
and for what purpose. It summarized the results of the following activities: 

(1) a conventional literature review to determine the trends In HEGIS usage, 

(2) a statistical sampling of the relevant literature to determine the level 
of use, and (3) Interviews and surveys of users to obtain Information on the 
use of the HEGIS data and on opinions about Its use* The following conclu- 
sions resulted concerning the Information needs served by HEGIS: 

HEGIS data have provided a foundation or base for the majority 
of reports 4nd books that have affected public policy on higher 
education * Almost everyone that was Interviewed agreed with 
this hypothesis while admitting to the principal Investigator 
that It Is difficult to show a direct cause and effect relation-* 
ship* As noted more extensively In the body of the report, many 
factors and Interests contribute to the development of public 
policy, not least of which Is the lobbying of representatives of 
higher education* During the process of setting policy and 
making law, lobbyists and analysts both at the executive and 
legislative levels have to consider the Interests of many con- 
stituencies and conflicting priorities* However, It appears 
from a review of higher education as well as from other litera- 
ture that Ideas behind much policy and law generally precede the 
full development of policy and Its conversion Into law by sev- 
eral years* In higher education, for example, the Carnegie Com- 
mission for the Study of Higher Education has produced extensive 
studies on higher education, many of which utilized statistics 
from the Higher Education General Information Survey system and 
other sources, such as the Census, to describe the condition of 
higher education and to provide a foundation for policy recom- 
mendations* It seemed to this author and to many Interviewees 
that a considerable amount of higher education law and policies 
In the seventies appeared to be derivatives of much of what was 
recommended by such foundations as Carnegie and the research 
sponsored by various federal and state agencies* Other evidence 
that HEGIS data provide a base for law Is found In the extensive 
quotation of HEGIS data during Congressional Hearings on Higher 
Education (see the review of literature for examples) and 
reports by Interviewees* Host educational associations develop 
voluminous reports on the condition or projected condition of 
higher education for their own constituencies, as well as appro- 
priate staff of congressional committees and executive agencies* 
In addition, the staff of associations and of Congress work 
closely together by telephone and memoranda with association 
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staff supplying data or analyses* The data come from the asso* 
clat Ions' own research, the Bureaus of Census and Labor Statls-^ 
tics, and from HE6IS* (For an example of how associations work 
with Congress, see Roarlc, Oct* 6, 1980, p. 30 

Enrollment and financial data are used much more extensively 
than other survey data for analyzing the Condition of Higher 
Education, policy analysis » and for making decisions at state 
and local levels * This Is probably true* (True Is used here 
and elsewhere In the report In a relative sense*) However, 
Degrees and Other Awards Conferred data are used extensively In 
conjunction with enrollment data for manpower planning and 
evaluating affirmative action programs and persistence of stu-* 
dents* Faculty and employee salary data Is reported extensively 
as Is tuition and fees because of the Impact on personal and 
Institutional decisions* These data are used to some degree In 
policy development* 

Accuracy has Improved * Generally the accuracy of all surveys Is 
deemed acceptable* The lone exception to this Is In aspects of 
the financial survey* The financial survey file Is probably 
used more than other files In making complex analyses of the 
condition of higher education* Moreover, there are many dlff l*-* 
cultles In reporting and Interpreting financial data because of 
differences among Institutions In government and accounting prac*- 
tlces* Thus, reports of dissatisfaction with the relative accu'' 
racy of the HE6IS file were not unexpected* The major problems 
with the financial file are summarized In Chapter II* The find- 
ings were drawn from Hyatt and Dlckmeyer, An Analysis of the 
Utility of HEGIS Financial Data , Hay 22-23, 1980* It seems that 
many of the problems with the file would probably be corrected 
by more extensive documentation about the accounting practices 
and governance of certain Institutions* 

What was unexpected was the relatively high esteem that surveyees 
and Interviewees had for the accuracy of most of the files* A 
recent study by NCES confirms the opinion of surveyees and Inter- 
viewees about the relative accuracy of enrollment and degree 
data* The NCES study (Westat, 1979) reported that there was 
less than one percent difference between survey and audit data 
on enrollment and degree data* However, certain caveats are In 
order about the accuracy of the files* Some researchers are 
concerned about the levels of aggregation In the files on 
Enrollment and Degrees Awarded* Another respected researcher 
believes that the financial file Is more accurate than per* 
celved, relative to the other files, and that the concern about 
the file Is a function of Its extensive study and use, as she 
believes expectations concerning accuracy Increase with the use 
of data* It Is also worth noting that one Interviewee familiar 
with how library data have been collected or estimated In the 
past questioned the accuracy of this file* Library and facili- 
ties data have not been reported nor collected for some time 
and, therefore, not used extensively, at least for complex 
analysis. In the last few years* \ ' 
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HEGIS l8 a system that would have to be Invented If It were not 
already In place because of the Increasing need for data In 
policy making and planning ♦ Everyone agreed with this notion^ 



The uses of HEGIS data have Increased significantly In recent 
years, particularly In the sophistication with which they are 
used* 



(Andrew, 1980, pp* Iv-xv) 



In addition to these conclusions, the Andrew (1980) report provided some 
tabulations that Indicate the usage of the HEGIS data* Andrew* s literature 
review Identified four major uses of the HEGIS data: (1) the description or 
condition of higher education, (2) policy and planning decisions, (3) pro- 
jections, and (4) other* Table A-1, taken from the Andrew (1980) report. 
Indicates the frequency of use by different types of users* Description of 
higher education. Including Information on enrollment, accounts for the most 
frequent use of the HEGIS data (51Z of the 873 citations)* This use prob- 
ably overlaps with that of policy and planning (22Z), since most descrip- 
tions are produced for policy and planning purposes* 

Further detail on the uses and purposes of HEGIS was provided by a sur- 
vey of 109 data users* Table A-2 presents rank orderlngs of the purposes for 
the HEGIS use by types and users* Manpower planning and enrollment projec- 
tions were ranked as first or second by all types of users* The Importance 
of enrollment data Is underscored by the results on the use of the. HEGIS 
data. The highest percentage of respondents (65Z) reported using the data 
from the Fall Enrollment Survey* 

This report did, however, note some problems with HEGIS that relate to 

the major purpose of acquiring and disseminating meaningful statistics on 

higher education* These are listed below* 

Timeliness of HEGIS data Is seen as a major problem * This was 
found to be a major problem with HEGIS* The delay of nearly a 
year or more, justified or not, between collection and distribu- 
tion of data In machine processable form and hard copy publica- 
tions Is seriously affecting the use of HEGIS* Though there has 
been recent Improvement In releasing tapes of certain files 
faster, there Is still considerable dissatisfaction with the 
timing of releases. This dissatisfaction Is reflected In find- 
ings from surveys and In the comments of researchers who work 
both for educational associations and Institutions, charged with 
reporting to their constituencies and/or supplying data for 
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Table A-1 

Purposes for Which HE6IS Data 
are Used by Groups Utilizing HE6IS Data* 

(Numbers la parantheses are percentages of total) 



User 



Purpose of Use 

Policy/ 
Description Planning 



Other/ Row 
Projections None Total 



Federal Govemtnental 16 
Agency (1 . 8) 

State Govemoent 22 
Agency' (2.5) 

Quasi-Governmental 44 
Agencies (3.0) 

Institutions 205 

(23.4) 

General Public/ 106 

Other (12.1) 

Scholars 36 



(6.4) 



(0.8) 



14 



(1.6) 



11 



(1.3) 



108 



(12.4) 



38 



(4.4) 



14 



(1.6) 



(0.2) 



(0) 



(0.2) 



26 



(3.0) 



11 



(1.3) 



(0.6) 



(0.8) 



(0.1) 



(0.3) 



98 



38 



(4.4) 



39 



(4.5) 



32 



(3.7) 



37 



(4.2) 



60 



(6.9) 



437 



(11.2) •• (22.1) 



193 



(22.1) 



114 



(13.1) 



Column 
Totals 



449 



(51.4) 



192 46 186 

(22.0) (5.3) (21.2) 

Total - 873 



*Most common purpose for using HEGIS data is for description; 22% of 
citations Involve using HEGIS data for policy/planning. 



(Taken from Table 2.1 In Andrew, 1980) 
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Table A-2 

Uses of HE6IS Data Rank Ordered Uichin Groups by Purpose (Inmost used) 



EUtnk Order of Frequency 



Purposes 



Quasi- 
Governmental 

and 
Association 



State 
Boards 



Institution/ 
Scholars 



Federal 
Govermnent 



(1) Investigating financial 2 
conditions of higher 

education 

(2) Manpower planning 2 

(3) Enrollment projections 1 
(A) Market planning analysis 3 

(5) Library planning 4 

(6) Facilities planning 4 

(7) Status of higher education 

(a) by private sector 1 

(b) by public sector 2 

(c) in adult and continuing 
education 3 

(d) in vocational/ 

technical education 4 

(8) Other 3 



2 
1 

3 
1 

1 
1 

3 

3 



1 
2 
1 
3 



3 
3 



2 
2 



2 
2 



1 
1 



(Taken from Table 4«10 in Andrew, 1980) 
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making administrative and budget decisions* Students of higher 
education also voice the same complaint* The lack of timely 
data, as well as difficulties In accessing data In machine pro- 
cessable form (If the data aren't used regularly), probably 
leads Institutions and associations to do more collecting of 
data through their own surveys (formally or Informally) that 
would be unnecessary If HEGIS data were released more quickly* 

However, the expectations of some Institutional researchers for 
delivery of data to support budget proposals, etc*, can probably 
not be met* The primary purpose of HEGIS was and Is to report 
on the condition of higher education at the national level, 
though such reporting necessarily requires analyses of various 
sectors of the enterprise* But the data are also used for 
secondary purposes (for example, making comparisons among Instl^ 
tutlons by Institutions and state agencies)* These uses have 
occurred because the system provides for consistency In report- 
ing on such matters as finances, degrees and enrollment for a 
universe of Institutions* Generally, comparative data are 
wanted by state agencies and Institutions for budget analyses* 
Since the budget cycle Is almost continuous at the Institutional 
level and budget development for the next year generally begins 
before actual data on the current year are collected by HEGIS, 
Institutions find that they are required to use projections and 
revise them as actual data Is collected* These revisions quite 
often are occurring as their reports to HEGIS go forward to 
Intervening agencies, such as state boards, for edits and even- 
tual forwarding to NCES for further edits* Thus, by the time 
NOES has the data for edit. Institutions may have completed 
their budgeting process for the next year* The cycle and the 
process therefore appear to preclude NCES' ever delivering 
reports In time to support budget requests by Institutions* 
Thus, what Is going on will probably continue, and. In a sense, 
provides a use of HEGIS In a very Informal way— the trading back 
and forth of data among Institutions that they have collected 
for their own management or for HEGIS long before such data do, 
or could possibly, appear In HEGIS reports* 

This Is not to to excuse HEGIS from the requirement to report 
results of Its surveys earlier* Currently, certain HEGIS data 
are reported In hard copy form as much as two years after the 
data were collected* Tapes and publications tend to be released 
as much as a year or longer after the data were collected* This 
Is unacceptable* There was general consensus among Interviewees 
that the data should be published both In machine processable 
and hard copy from six months and a year (even If this meant 
leaving out late reporting Institutions, thereby sacrificing 
completeness and accuracy) after collection* 

HEGIS data have not been used as extensively as they might be In 
reporting on the condition of women and minorities In higher 
education because overhead or start-uj> costs In using HEGIS data 
for analysis Is relatively high * Experienced users tend to dis- 
agree that start-up costs are high; but then they have already 
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paid those costs* There has been a spurt of studies on ethnic 
groups and women In higher education In the last year, quite a 
bit of It being published and disseminated since the review of 
the literature was published* Thus the conclusion may not be 
tenable In the future* 

HEGIS Is not being used as fully as It might be for policy 
analysis^ planning and evaluation by either business or unlver- 
slt_y scholars* As noted earlier, there Is only a small coterie 
of scholars and students In universities that Is using HEGIS for 
the above purposes* While there are strong Indications that 
data are being used somewhat by businesses for planning recruit- 
ment and evaluating or negotiating affirmative action programs, 
these uses seem fairly unsophisticated* There Is little Infor- 
mation In the general literature on higher education about the 
contents of HEGIS and how to use It* 

More data are wanted on student characteristics and financial 
aid* Without question more Information Is wanted on the latter* 
There appears to be more disapproval than approval for HEGIS* 
collecting data on student characteristics. Institutional quality 
and outputs* However, there Is more and more demand for such 
data from policy makers and consumers* Data are being gathered 
and data bases are In place or being developed* Some Inter- 
viewees suggested that NOES should act as a broker In gathering 
data from other Department of Education program offices, funding 
the collection and maintenance of data bases, and disseminating 
data* 



The Andrew (1980) study also Indicated the partial achievement of the 
secondary purposes of HEGIS — to reduce the response burden and to attain 
consistency* 

The collection of HEGIS data has had an Impact on the discipline 
and sophistication of data collection systems at institution and 
state levels * This seems to be a reasonable conclusion* It was 
generally agreed that this discipline has facilitated the 
exchange of Information among Institutions* 

The collection of HEGIS data does not Impose a heavy burden on 
Institutions since most of the data would be collected by Insti- 
tutions and/or states for management purposes anyway* This con- 
cluslon seems reasonable although opponents of government regu- 
lation and data collection may argue with It* The Interviewees 
did not see a heavy burden for ongoing systems* There Is a dis- 
tinct burden cost when changes are made In taxonomies, question- 
naires (both of which can cause reprogrammlng) and /or changes In 
schedules* 

Institutions are concerned about the uses of HEGIS for compari- 
son purposes* This conclusion certainly holds for comparison of 



(Andrew, 1980, pp* Iv-xv) 
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unit costs, resource allocation, and funding* Generally insti- 
tutions do not believe the data can be used for institution-to- 
institution comparisons because of timeliness, or lack thereof; 
lack of appropriate detail; differences in organization and 
accounting practices; and inappropriate comparisons of unlike 
institutions* 

There was general agreement that data are required from all of 
higher education because of differences among institutions and 
the uses to which the data are put » Moreover, most compilers at 
the institutions felt that the burden of collection would be 
increased rather than lessened if a sample of institutions was 
taken because of the increased problems in planning for and man*- 
aging the collection* 

HEGIS data can be used for making comparisons among sectors of 
higher education * In fact, many would argue that it is accurate 
enough, handled appropriately, for making state-to-state and 
inter-institutional comparisons* 

(Andrew, 1980, pp* iv-xv) 
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APPENDIX B 



Listing of the Nationally Recognized 
Accrediting Agencies and Associations 



Regional Accrediting Commissions 

New England Association of Schools 

and Colleges, Commission on Institutions 

of Higher Education 

New England Association of Schools and 
Colleges, Commission on Vocational, 
Technical, Career Institutions 

Middle States Association of Colleges 
and Secondary Schools, Commission on 
Higher Education 

North Central Association of Colleges 
and Schools, Commission on Institutions 
of Higher Learning 

Northwest Association of Schools and 
Colleges, Commission on Colleges 

Southern Association of Colleges and 
Schools, Commission on Colleges 

Western Association of Schools and 
Colleges, Accrediting Commission for 
Senior Colleges and Universities 

Western Association of Schools and 
Colleges, Accrediting Commission for 
Community and Junior Colleges 



National Institutional and Specialized Accrediting Bodies 



National League for Nursing: 
associate degree program in 
nursing 



American Veterinary Medical 
Association: associate degree 
program in animal technology 



American Association of Nurse 
Anesthetists, Council on 
Accreditation: nurse anesthesia 



American Medical Association, 
Committee on Allied Health Education 
and Accreditation: assistant to 
the primary care physician 



National Architectural Accrediting 
Boards : architecture 
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APPENDIX B (cont'd) 



American Library Association, 
Committee on Accreditation: 
librarianship 

American Society of Landscape 
Architects: landscape architecture 

Accrediting Bureau of Health 
Education Schools: medical 
assistant 

American Medical Association, 
Committee on Allied Health 
Education and Accreditation: 
medical assistant 

American Medical Association 
and Association of American 
Medical Colleges, Liaison 
Committee on Medical Education: 
medicine 

American Medical Association 
and Association of American 
Medical Colleges, Liaison 
Committee on Medical Education: 
basic medical science 

American Association for Marriage 
and Family Therapy Education, 
Commission on Accreditation for 
Marriage and Family Therapy: 
marriage and family counseling 
(clinical) 

American Association for Marriage 
and Family Therapy Education, 
Commission on Accreditation for 
Marriage and Family Therapy: 
marriage and family counseling 
(graduate degree) 

Accrediting Bureau of Health 
Education Schools: medical 
laboratory technician 

American Medical Association, 
Committee on Allied Health 
Education and Accreditation: 
medical laboratory technician 
(associate degree) 



American Medical Association, 
Committee on Allied Health 
Education and Accreditation: 
medical laboratory technician 
(certificate) 

American Medical Association, 
Committee on Allied Health 
Education and Accreditation: 
medical record adodnistrator 

American Medical Association, 
Committee on Allied Health 
Education and Accreditation: 
medical record technician 

American Medical Association, 
Committee on Allied Health 
Education and Accreditation: 
medical technologist 

National Association of Schools 
of Music: music 

American Medical Association, 
Committee on Allied Health 
Education and Accreditation: 
nuclear medicine technologist 

National League for Nursing: 
baccalaureate and higher degree 
program in nursing 

American Op tome trie Association, 
Council on Op tome trie Education: 
optometry 

American Osteopathic Association, 
Office of Osteopathic Education: 
osteopathic medicine 

American Medical Association, 
Committee on Allied Health 
Education and Accreditation: 
occupational therapy 

Council on Education for Public 
Health: public health 

American Council on Pharmaceutical 
Education: pharmacy 
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National Association of Schools 

of Art, Conimlssion on Accreditation 

and Membership: art 

American Speech, Language, and 
Hearing Association: audiology 

American Medical Association, 
Committee on Allied Health 
Education and Accreditation: 
specialist in blood bank technology 

American Association of Bible 
Colleges: Bible college education 

American Assembly of Collegiate 
Schools of Business: business 

Council on Education for Public 
Health: community health education 
(graduate degree) 

Council on Chiropractic Education, 
Commission on Accreditation: 
chiropractic education 

Council on Education for Public 
Health: community health, preventive 
medicine (graduate degree) 

American Psychological Association: 
counseling psychology 

American Medical Association, 
Committee on Allied Health Education 
and Accreditation: cy to technology 

American Dental Association, Commission 
on Accreditation of Dental and Dental 
Auxiliary Programs: dental assistant 

American Dental Association, Commission 
on Accreditation of Dental and Dental 
Auxiliary Programs: dentistry 

American Dental Association, Commission 
on Accreditation of Dental and Dental 
Atixlliary Programs: dental hygiene 

American Dietetic Association: 
dietetics 



American Dietetic Association: 
dietetic internships 

American Dental Association, 
Commission on Accreditation of 
Dental and Dental Auxiliary 
Programs: dental laboratory 
technician 

Engineers* Council for Professional 
Development: engineering 

Engineers' Council for Professional 
Development: engineering technology 

Foundation for Interior Design 
Education Research: interior 
design education; professional 
and technical programs 

Society of American Foresters: 
forestry 

American Board of Funeral Service 
Education: funeral service education 

Accrediting Commission on Education 
for Health Services Administration: 
health services administration 

American Medical Association, 
Committee on Allied Health 
Education and Accreditation: 
histologic technician 

American Psychological Association: 
internships in clinical and 
counseling psychology 

American Council on Education for 
Journalism, Accrediting Committee: 
journalism 

Association of Independent Colleges 
and Schools, Accrediting Commission: 
private junior college of business 

American Bar Association, Section 
of Legal Education and Admissions 
to the Bar: law 
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APPENDIX B (cont'd) 



National Association for 
Practical Nurse Education and 
Service: practical nursing 

National League for Nursing: 
practical nursing 

American Podiatry Association, 
Council on Podiatry Education: 
podiatry 

American Physical Therapy 
Association, Committee on 
Accreditation In Education: 
physical therapist 

American Physical Therapy 
Association, Committee on 
Accreditation In Education: 
physical therapist assistant 

Association of Advanced Rabbinical 
and Talmudlc Schools, Accreditation 
Commission: rabbinical and 
Talmudlc education 

American Medical Association, 
Committee on Allied Health 
Education and Accreditation: 
radiologic technologist 

American Medical Association, 
Committee on Allied Health 
Edtiatlon and Accreditation: 
respiratory therapist 

Am&rlcan Medical Association, 
Committee on Allied Health 
Education and Accreditation: 
respiratory therapy technician 



American Psychological Association: 
school psychology 

American Speech, Language, and 
Hearing Association: speech pathology 

Association of Independent Colleges 
and Schools, Accrediting Commission: 
private senior college of business 

American Medical Association, 
Committee on Allied Health 
Education and Accreditation: 
surgery technology 

Council on Social Work Education, 
Commission on Accreditation: 
social work 

National Council for Accreditation 
of Teacher Education: teacher 
education 

Association of Theological Schools 
In the United States and Canada: 
theology 

American Veterinary Medical 
Association: veterinary medicine 



Nationally Recognized State Agency 
New York State Board of Regents 
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APPENDIX C: 



Suggestions for Improving the Wording and 
Format of the Fall Enrollment Survey 



The wording and format of a questionnaire can be critical to the gath- 
ering of accurate data. The following are some specific suggestions for 
Improving the wording and format of the Fall Enrollment Survey within HEGIS 
(Figure C-1 presents selected pages of the questionnaire)* 



Page 1 

(1) Item 1, the block for writing the Institution code number 
(located In the upper right hand comer), Is surrounded by 
Information for the respondent* This could be missed by 
respondents* 

(2) Item 2 9 Indicating the due date, Is not a block In which 
respondents are to write* It should not have a number* 

(3) Item 6 Is written In all capital letters* This Is much 
harder to read than text that Is In upper and lower case* 
In addition, the wording of the Instructions can be made 
clearer and shorter* 

(4) Item 7 can be mlide more direct* 

(5) The ordering of the definitions Is confusing* The explan- 
ation of a multi-campus Institution requires an under- 
standing of what an Institutional system Is* To reduce 
the crowding on the pages, these definitions could be 
moved to the second or third pages — if they are necessary* 

(6) Three different styles of type are used* This makes the 
form look more complicated* 



Page 2 

(7) A brief guide indicating that there are three parts to 
this report would help orient the respondent* 



Page 3 

(8) The purpose of the note at the top of the page is to bring 
the mail-in card on the last page to the respondent's 
attention* It should be shortened and Included as part of 
the guide information* 
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Figure C-1 
Reproduction of Survey Report Form 



OEPARTMENT OF HEALTH, EOUCATION, ANO WELFARE 
EOUCATION OIVISION 
WASHINGTON, o.C 202O2 

HIGHER EOUCATION GENERAL INFORMATION SURVEY CHEGIS XIII) 

FALL ENROLLMENT AND COMPLIANCE REPORT 
OF INSTITUTIONS OF HIGHER EDUCATION, 1978 



PLEASE 
READ 
INSTRUCTIONS 
BEFORE 
COMPLETING 
THIS FORM* 



FORM APPHoVeo 
0MB No. 5Y-*R073S 



MNSTITUTION COOE NUMBER 



2. OUE OATC 

Not iatir than Nmmbir 15, 1971 



NOTICE: Piii report is mindaioty only for ihoie Iftsiilullont tubjecl 
to tht fcsulrcmenu of Tllte VI of the CM Rights Act of 1964 ind 
Title IX of the Education Amendmenu of 1972. For the other insti- 
tutions, it H valuntai>-. See page 2 for further information. 



Please supply lU the identifying informillon requested on thU page. 
When the survey form hu been completed, pleue return It either 
directly to Department of Health, Education, and Welf^, Education 
Division, National Center for Education Sutittlcs. ATTN: Room 3073 
HECIS, 400 Maryland Avenue. SW, Washington, D.C 20202, or to the 
HECIS coordinator, if there Is a HECIS coordinator In your Sutc. 



2. NAME Ar^O MAILING AOORESS OF INSTITUTION OR CAMPUS COVEREO BY THIS 
REPORT 0nctti^9 citr, Strnf, ZIP «4Kf«i 



4, NAMt£ ANO TITLE OF RESPONOENT 



S. TELEPHONE NUMBER OF RESPONOENT (•f«« c»rfi*« 



4. PLEASE NOTE THAT EACH INSTITUTION. BRANCH, CAMPUS OR OTHER ENTITY SEPARATELY CERTIFIEO BV THE ACCREOITATION 
ANO INSTITUTIONAL ELlClBtLITY UNIT OF THE U.S. OFFICE OF EOUCATION, WITH IT'S OWN FICE COOE, ANO LISTEO SEPARATELY 
IN THE EOUCATION olRECTORV • HIGHER EOUCATION* SHOULO BE REPORTEO ON A SEPARATE SURVEY FORM ANO NOT INCLUOEO 
OR COmBINEO with any other SUCH CERTIFIEO UNIT, BRANCHES, CAMPUSES, ANO OTHER ORGANIZATIONAL ENTITIES NOT 
SEPARATELY CERTIFIEO SHOULO BE INCLUOCO WITH THE APPROPRIATE INSTITUTION OR BRANCH REPORT. IF SUCH ARE INCLUO> 
EO tN THIS REPORT, PLEASE LIST THEM BELOW, 



ARE OATA FOR 
THIS UNIT INCLUO. 
EO IN THIS 
REPORT* 


NAME OF BRANCH ANO/OR oTHER CAMPUS 


AOORESS (eltr* M 


Id ZIP tod9f 




ClNO 


1 




CIVEI 


CJNO 






Clrtl 


riNo 







7. IF THE EOUCATiONAL ORGANIZATION OR ENTITY COVEREO BY THIS SURVEY REPORT IS PART OF A MULThCAMPUS INSTITUTION, 
OR PART OF A SYSTEM OF INSTITUTIONS. PLEASE ENTER THE NAME OF THE INSTtTUTtON OR SYSTEM BELOW. 
IF NOT APPLICABLE. CHECK HERE^^O 



DEFINITIONS 



MULTt*CAMPUS INSTITUTION. An organitation bearing a rcKrn* 
bUnce to an institutional system, but unequivocally designated as a 
liAgle Instiiutiofi with either of two orpniutlonal itructuici: (1) an 
iiiitltution having two or more campuKS reiponiible to a central ad* 
ministntion (which centnl administration may or may not be to- 
Gittd on one of the administratively equal campuKS) or (2) an insti* 
tutlon having a main campus with one or more branch campuses at* 
tachtd to It 

MAIN CAMPUS. In those Institutions comprised of a main campus 
and one or more branch campuses, the main campus (sometimes 
called the parent Institution) Is usually the location of the core, prl* 
maiy, or most comprehensive program, l/nieu the InstitutloiVwldc 
or central administrative offke for such Institutions Is reported to be 
■t • different location, lha main campus is also the location of the 
ctntnl administrative ofOce. 



■RANCH CAMPUS. A campus of an Institution of higher educa* 
tlon which it organited on a relatively permanent basis U.t., Has a 
relatively pcimanent administration), which offers an orpnlzed 
program or programs of work of at least 2 years (u opposed to 
courts), and which it located in a community different from that 
in which lu parent tnttltutlon Is located. To be considered in a com* 
munlty different from that of the parent Institution* a branch shall 
be located beyond a reasonable commuting distance from Ihe main 
campus of Ihe parent institution, 

INSTITUTIONAL SYSTEM* A complex of two or more Institu* 
tions of higher education* each separately organized or Independent* 
ly complete, under the control or supervision of a sin|ie admlnistre* 
tlvt body, 



OC FORM Za»2*X 7/70 Cofftro/ No. S6I RIFLACSS OE FoRM a30O*2.X 4111, WHICH IS OB80LITB 

I 
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Figure C-1 (continued) 



VOLUNTARY VERSUS REQUIRED REPORTING 

This survey consiliuics an integral pari of ihe comprehensive $yslem of siaiisiics on higlier educaiion 
collected by the NaiionaJ Ccnier for Education Statistics (•WC£S) as part of the Higher Education Gene* 
ral Information Survey (HEOIS), 

In recent years, for the purpose of enforcing compliance with Federal regulations implementing civil 
righU laws applicable to institutions of higher education, the OfRce for Civil Rights (OCR} has been col* 
lecting similar enrollment data on a mandatory basis* 

In order to lighten the burden on reporting institutions by eliminating the considerable duplication of 
effort in reporting enrollment data to two separate agencies, the two surveys have been combined into 
this single questionnaire and integrated inio the HEGIS program. 

Completion of this questionnaire is mandatory for all institutions of higher education which receive, are 
applicants for, or expect to be applicants for Federal financial assistance as defined In the Department 
of Health, Education and Welfare (HEW) regulation implementing Title VI (45 CFR 80,13). or as de* 
fined in any HEW regulation implementing Htlc IX. (Ste alio the Instructions for complettng this 
questionnaire,} 

Those institutions to which the regulations do not apply are nut required to complete this questionnaire. 
However, it is hoped that institutions not subject to these ptovisions will voluntarily complete the en* 
tire survey-or at least the Summary page-in order that the data may represent the entire universe of 
higher education. As i minimum NCES requests that institutions complete columns 13 through 15 on 
the Summary page in order to enable NCES to continue to provide basic enrollment data serving the 
needs and interests of the higher education community. 



BEST COPY AVAILABLE 
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Figure C-1 (continued) 



NOTE. 



INSTRUCTIONS AND DEFINITIONS 

Tht card tfiai farms tht back cqvm of ihit npotX ft lor tfit convinlanct of ittponrfantt In providing praliminary data for a pr^publlGation 
rtlaaii. Tht botlom half of tfit card ft a iitf*mailtr that can bt dttachtd without looiinfng tht pagai of tht raport 



GENERAL INSTRUCTIONS 



Proofread tlw cumpleied report bcfoK returnincit to the National Center 
for luiucjtion Staiitticx. 

ThU report ahuuld Include only co11e|c>1evel trudenU rakint work creditable 
toward a buchdorS or hiiherdefrec or tome other formal recofnition below 
the baccalaureate. 

If C5(act counts are tacklni fur a partleular category of students that should 
be reporredt Include an estimate for that j^roup. 

Do NOT nil out MTivarate fo^mi for cMcntion center*. Only campiwcs with 
thdr own MCK code numbcrt thould be tt: ported on Kparato questionnaires* 
tixtonsion students tlirald be reported on rhc form for the main campus. 

Do NOTIm:lude In this rcpurt: 

ta) Students In noncredit adult education courses. 

{b\ Studtinu rakini cuurvet «t home by mail* radio, or television. 

tc) Students enrolled only for ""short eourses*** 

Id) Auditors. 

(e) Students ttudyinf abroad ir their enrollment at the rcportinyc inatitu* 
1 tlon Is only an administrative r«t:ord and Ihe fee is only noniinjJ. 

(0 Students in any branch t'ampus or e5(tciiiion center in a foreign 
«*(Hintry* 

<|tl Hi|h sciioot studenu taking college «:uursc%. 

th J Student! knuwn to be enrolled eoneiirrentJy at another college or 
. unl vcrsity* if the latter will report thdr enrollment f to avoid Joubfe- 
cwl nting), Nurmaily* tha Irutltution that will eventually grant tlie de* 
grce* thould report the atudent*s enrollment* 

AfOTt\ S*o nutter whet the votctiJcr tyutm, ffi*Oft on thb qutsti»n$$cifr 
ontx* thi7se sfuUents enroM onJ onfy those ereUit-honrs being earned Uur^ 
btKthel'^AU Tk'RM 

If you no ed CLARII*ICATION of any item un thv quettionnaire that per* 
tatns to AiU enrollment* pleaw nil the Survey Director. Dr. Andrew J. 
fepln* nC ES*f202) 245-8392, in Washington* O.C. 20202. Any ques- 
tkins eonciisming the raeial/eihnie eaieguries ur majnr fields uf stuJy 
tfiould be i llreeted tni.ML (arni Campbdl* OAlee fnr Civil Rights. 
(202} 245*:7420Jn Waihlnpton* D*C. 20201. 

WAIOR FlEtLDS OF STUDY AND COR RESPO*N DING IHAJOR FltLD 
CODES. 

The lifting balow identifies %e1cLtcd categoriei of major fields of itudy. and 
their cwespomdingc^odci. Dick* were taken directly from the MECiS Tax- 
onomy of irua'uelk)nal Pyograms in Higher Edueation and aggieiaied intu the 
fidds listcilt Tile flald name and corretponding code number have been pre* 
printed in the upper 1eft*hand corner of each page, tf your imtitution Iiai no 
students ettrollea^ In any of the designated fields* cheek titc bo\ ax indicated. 
Students ehtulled* in the ffelds of Dcntiitry* Medicine* Veterinary Medi- 
dno and Ltw art not to be reported ai undergraduate or graduatu stu- 
dents btii tmly aa *1*(rst*Profesiiunal students Students in these pro- 
grama requiring onVy 4 or 5 years beyond high ichool shuutd be report- 
ed ai undeirgraduate s in tht apprupriate fleldL 

0100 - Agrkutturvar*Hl Natural Rcsourcet 

0200 - Ardhltecturcand Knvlronmental Design 

0400 - Hiof ogkal Scielwv« 

0500- DuslneaftandMt nagement 

QqOO - hiiginocring 

1204 - ikfitistry 

1206 -Metlidnc 

13111 - Veterliury Mcdiciiie 

1400 - Uw \ 

1900 • Hiywcal Scitm-ci • 

Ot FORM 2300*2.9« 7/70 * /FA# Contfot Na S6t 



9000 • All oilier (firfdt aut hwhtdcJ ahuxr aaU uHiiet tiieiilunde^'lcrvd) ' 
9999 - Summary //c^re/ vnroi!n$tt$th In addition to separate reports for each 
uf the major fietdi or sub-fields listed above, complete the Summary 
report which aggregates the enrollment data on the individual field 
report^, 

Column 1 5 will be completed ONLY for the Summary report. 
Indhrldual reports «iU NOT ihow data In culumn 15. 

FILING INSTRUCTIONS - COMPLIANCE REQUIREMENTS* 

Title VI of the Civil Righu Act of 1964 requires that recipients of Federal 
financial asitstanee offer their benefits and services without reprd to nee* 
color, or national origin. TItJe IX of the Education Amendments of 1072 
requires that Ihe benefits and servieet uf federally «uiited educational pro* 
graiiH and activities be offered, with certain exceptions* nondlierimlnatori* 
ly on the bails of se.\. DiU report is one indicator utilized by ilie Office 
for OvU in caroing out iit responsibilities to verify eomplianee 
with TllleVI and Title IX. Alio applicable arc Section 799*A. part H. 
Title VII and Section 845* Part C. Title VIII of the Public Health Service 
Act uf 1972. 

Tills report Is to be filed by all initltutions of higher education which receive* 
are applicants for, or expect to be applieanU for Federal Onaneijl assistance 
as defined in tlie Department of Health* Education, and Welfare ReguUtiun 
implementing Title Vl(4SCFR8afJK or ai defined in any Department of 
Health, Bducation. and Welfare Reflation implementing Title IX, If your 
institution doea nut fall into any of iheic categories, please inform us of this 
fkt. 

Section 80.6<b) of the Regulation implen^enrlng Title VI* set forth below,, 
and similar pruvliionf of the Title VI Regulations of other Kederal agencies, 
authorize eolfcction of this infurmatlon: 
80.6 Compliance infotmation 
<bl Compllanee reporU*** 

Each recipient thrill tceep such records and submit to the reipontible De* 
partment ofTielai or hit deiignee timely* complete and aeeurateeompll* 
ance reports m tuch times, and In tueh form and containing such Infor* 
Illation* at the tetponsible Department official or his designee may deter* 
mine to be necesury to enable him to ascertain whether the recipient 
has cum plied or i< complying %vith this part. Tor example* reeiplenu 
ihuuld have avaUable fur the Department racial and ethnic datt ihowlng 
tJie extent to which members of minority groups are beneficiaries of and 
participants in federally -a aisled programs. |n the case of any program 
under wiiieh a primary recipient extends Federal flnineial aulitance to 
any mhcr revipient. tuch other recipient shall alio submit sueh compli- 
ance repocts to the primary recipient as may be necessary to enable the 
primary recipient to carry out its obliptlons under this part 

Kaeh institution uf higher educatioi** as well as each separately L*crtif1ed 
branch ca»npih fwith itt ontj FtCb\ode numhtrt that i« lubjecl ro rhc HKW 
civil rights regulations cited above is required to complete a separate eonipli* 
ance repurt for Ceruin selected major fields ///rrct/ ^</otJ at indicated in the 
upper 1eft*hand corner of each pMge. 

RACIAL/ETHNIC CATEGORIES* 

Jbt following five raeial/ethnte categories are utiliied in the »urvey: 

Btaeic Non*Hi<panie 

American Indian or Ala%l(an Native 

Asian or Pacific Inlander 

Hispanic 

White Non*Hiftpanie 

In addition* nomrckident alieni» i.e>, ihote intfmber< of the aforementioned 
groups who Itave not been admitted to the United States ri>r pcfrnvnent 
residence, should be separately identified m» a sixth category; the nonresi- 
dent aliens are not separately requested by. racbl/ethnle poup, but only in 
lotAlL 

The deflnirions for these eategoriei are; 

Non«rcsident alien* A person who is not a dtlzen of the United 
States and who is in this country' on a temporary batit and doei not 
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Figure C-1 (continued) 



hive Ihc rf|hl lo remain indeflnildy* Reiideni ilknt* noivciiizeni 
who have been lawfully admHied for pernunent residenee f^nd whn 
holds **xrren vsrdr Forml-ISJj, are lo be reported In the appropri- 
ate rteUl/cthnk carcgorics a1on| «<ith Uniled Statet dliiini, Noih 
reildent aliem are to be reported Kpantdyf In the edumns pfovldedf 
nther than In any of the live neUl/ethnk atqiociei whkh follow. 

Blick HoifHitpanle* A person havfnii orlfini In any of iht 
bUck raebl froupi of Africa. 

Americtn Judian or Alaikan Nittvt, A person having ori|tni 
m any of ihe original peoples of North America, and «-ho 
maintalna eultural identification throuph trihal afrUIailon or 
community recognition* 

Asian Of ftdHc IsJandert A person having orlidns in any of 
the original peoples of the l-ar tasi* Souiheait Asiat lite 
Indian subcuntinentt or tlie paeifk Islands. This area in* 
dudcs,,fur exampicf China* India, Japan, Korea, the VhtWp- 
pine Islands, and Samoa, 

Hispanic. A person of Mesictin. Puerto Rican, Cuban. Ceii* 
Iral or South American or other Spanish eulture or origin, 
repardleu of race. 

IVhltt Non*Hlspanic* A person having orijdns in any of the 
original peoples of Kurope* North Africa, nr in rhe l^tlddle 
Vast* 

Radil/cthnie desifnatloni as used In ihls survey do not denote Kienilfle 
deflnillons of anthropologieal origins. l*or the purpose of this report* a 
student may be induded In the group to whkh he or she appears lo bc> 
long. Identifies with< or is regarded in the community as bdonging* 
Kom^cTt no person may be counted in more than one radal/ethnie 
group. 

The manner of collecting the radal/eihnle information Is left iq the dis- 
cretion of theinstirution provided that the system whieh is established ro* 
«ultv In rea^nabU* Bi\urate data. One aeeepuble method is a property con- 
trolled system of po^t-enrollmeni kelMduniifkaiion by students. If a self- 
IdenliflcatloA method Is uiPiud, a verification procedure to aKnuin the 
complelcncssand accuracy of student submiulons should also be employ- 
ed where feasible. In order to provide reasonably aeeurate dau, the insii* 
tutlon may require students to complete a queitionnaire and/or identify 
Ihemidvcs by n^me or otheridsc when providing information. TYie fact 
that the information Is being gathered to comply with Title VI of the 
Uvil Rights Act of 1964 and TlUe IX of the E:ducatlon Amendments of 
1973 may be disseminated In the manner and to the ei^ient that the 
adminhtratlon deems appropriate. 

DEFINITIONS 

UNDERGRADUATES, Students enrolled in a 4* or S-y ear bachdor*a degree 
program. In an auodate degree prognm. or in a vocational or technical pro- 
gram that Is normally terminal and results in formal recognition bdow Ihe 
baccalaureate. 

CLASS LEVEU Uhether first-year, second-year* ete.* should be determined 
In a logical, eonsistent, and identifiable uiy. Usually, a student*a dass level 
would be based on the proportion of total requirements he has obtdned to- 
watd the compietion of the degree program in whkh he b enrolled, accord- 
ing to the number of yean normdiy required to obuin them. 

F1RST*TIME FRESHMEN. E^nienng freshmen who have not previously at- 
tended ANY college. Indude siudeAU enrolled in the fall term who attended 
college for the flnt time in the summer of I97S. Also inelude students who 
entered with advanced standing (cotlegt trtdin ismed before iraduation 
ffomhlgfi tehoofj at the freshman levd. 



OmER FIRST-YEAR. Mnt-year students who entered the institution be- 
fore the summer of 1978. 

UNCLASSIFIED STUDENTS. Not candidates for a degree or other formal 
award, although taking eouncs In regular elasse^ with other students. 

UNDl:RGRADUATF. LEVKL. Includes but U not limited to undergradu- 
ates who cannot be datsifled by clau standing; for example, new tranifcf 
Mudents. a1m> induded are students who already have bachelor's degroai 
or awardv h<lo«Mhe baccalaureate but are taking courses at the same kvri 
oc lower. Included also are **spedal students** and teachers uUi^ addl* 
tional undergraduata eourses for certification. 

POSTBACCALAUREATE LEVEU Includes but is not limitad to 
**Spedal** and other students taking fint-professional or graduate eourm 
but who are not working tovnrd a degree 

FIR5T*FR0FESS10NAL STUDENTS. Students enrolled in a professional 
Khoot or program whkh required at ieut 2 academk years of eollega work 
for entrance and a total of at least 6 yean for a degree. Report only studenit 
in those flni-professiona] degree programs In the field of medkine, law, and 
thcolog)' spedfkd in Part A of NCliS l orm 2300-2.1. Degrees and 
Other 1 ormal Anirds Conferred. Students in programs requiring only 
4 or S years beyond high school shook! he reported as undergraduateli 
and not In the first-professional fields. 

GRADUATE STUDENTS, Students who hold Ihe baehdor*s or f1rst*profea • 
sional degree, or equivalent, and are working toward a master's or doctor's 
degree. 

KIRST-YEAR. Graduate students who have completed lets tlun out 
full y es r of required graduate study . 

BEYOND THE FIRST YEAR. All graduate students who have com- 
pleted at least one fbll y ear of gnduate study t oward a muter*^ or 
doctot's depec 

FULL-TIME STUDENTS. Those whose academic load<oursework or othir 
tequlred aethHty is at least 1S% of Ihe norma) full-time load, 

» 

FULL-TIME-EQUIVALENT <FTE) ENROLLMENT OF PART*T1Mf I 
STUDENTS. Convert part-time students flfnet IS*28J into full-time equhr»* 
lents by one of the following; 

(I > Use i method already employed in your institution to eompt ite 
FTE*s for some other purpott. 

(2) Sum the credit houn for part-time sftidents and divide by thie Mt- 
ma) fua-time crtdit-hotir IomL (NORMAL I'ULL-TIMK CRE DIT- 
1I0UR LOAD) is usually determined by dividing tbe total nt imber 
of eredlts required for completing the program by the number of 
terms normally required to obtain them. Do not confuse i) tia %ith 
the minimum number of ercUli-houn required for a atuden*, to be 
daulfkd full-ilme (7S^; of a normal full-time load). NOTU? DivUt . 
by the normal* or averai^. full-time load, not by the mlnlnttun 
fblHime load, l-or most institutions, this wDI be IS credli.-lioon 

(not I2K 

(3) Aulgn a fnetional vdue of full-time to each part-time rnuilent* ip- 
propriaie to your institution, such as 1/4, t/), or 1/2. Re'mernbcr thai 
a student taking 3/4 (7S%J or more of a norma) full-time 'load should 
classified as a fuU-tlme atudent 
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(9) The Instruction — "Do HOT fill out separate forms for 
extension centers" — Is explained on p. 1; It can be 
eliminated* 

(10) The following revision of the section on Major Fields of 
Study and Corresponding Major Field Codes Is easier to 
understand: 

"Below Is the list of selected major fields of study 
and their corresponding code numbers* The list of 
fields Is based on data from the HE6IS Taxonomy of 
Instructional Programs In Higher Education* There 
Is a separate page In this report for each major 
field* The field name and code number Is In the 
upper right hand corner of the page* If your Instl-* 
tutlon does not have any students enrolled In a 
fields mark the box under the field name* Students 
In programs that require only 4 or 5 years beyond 
high school should be reported as undergraduates In 
their appropriate fields* Do not report students 
enrolled In the fields of Dentlstrv, Medicine » Vet- 
erinary Medicine and Law as undergraduate students* 
These students are Flrst-Professlonal students*" 

(11) The section titled Filing Instructions — Compliance Require- 
ments explains who must file and why* It Interrupts the 
Information on how to fill out the report* This should 
appear at the end of the Instructions* 

(12) This revision of the statement under the section on Racial/ 
Ethnic Categories Is clearer: 

♦ « 
"In addition, there Is a sixth category which con~ 
slsts of non-resident aliens, l*e*, people who have 
not been admitted to the United States for permanent 
residence* Non-^resldent aliens should only be 
Included under this category; they should not be 
Included In one of the above five racial/ethnic 
categories*" 



Page 3 and 4 

(13) A statement on page 3 regarding first professional stu^ 
dents Is not completely consistent with a statement on 
page 4: 

Page 3-^nder Major Fields of Study and Corresponding 
Major Field Codes 

"Students enrolled In the fields of Dentistry, Medi- 
cine, Veterinary Medicine and Law are not to be 
reported as undergraduate or graduate students but 
only as First-Professional students*" 
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Page 4 — under First Professional Students 

"Report only students in those f irst-professional 
degree programs in the field of medicine, law and 
theology as specified in Part A of NCES Form 
2300-2*1, Degrees and Other Formal Awards Conferred*" 



Page 5 

(16) The numbers in the first three boxes serve no purpose; 
they can be deleted* 

(17) The column number has been covered up; remove the masking 
for this section* 

These suggestions indicate some areas that may result in confusion for 
the respondents* A simplified version of the first two pages of the form, 
based on these suggestions, appears in the following pages* 
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Figure C-2 



Example of a Revised Survey Form 

Institutional Information 



FORM APPROVED 
0MB No. 51*Ro738 



Higher Education General Information Survey 
(HEGISXIII) 



United States Department of Education 

Fall Enrollment and 
Compliance Report 

of Institutions of 
Higher Education, 1981 



WOTICE: This report is mandatory only for those Institutions 
subject to the requirements of Title VI of the Civil Rights Act 
of 1964 and Title IX of the Education Amendments of 197Z 
Foe the other institutions, it is voluntary. See pages 2 and 4 for 
further information* 



Please read instructions before completing this form. 
DUE DATE: November 15, 1981 



1. Institution Code Number 



Z Name of Institution 
Street Address 



State Zip Code 

3. Name of Respondent 



lilie. 



4* Telephone Number of Respondent Area Code Number 



Extension 



Below, list any branchy campuses, or other organizational entities that are not separately certified by the Accreditation 
Lmiu'.'nV"n?h'^' Department of Education. Useasepa^te reportfor Sch'^^n^^^^^^^ 
Sr PHnri S„ t t H "^ST^^*^ Certified has its ov^ FICE code, and is listed separately in the Education Direc ory- 
SSt^TprfateTni^^^^ '""^ organizational entities that are not separately certified in the 

Name of Branch and/or Other Campus Address iCIty, State, ar>d 2fp Code) Date included In this report? 

□ Yes □ No 

. — : DYes DNo 

□ Yes □ No 

lU«em omS ^^""^^^ """^^ ^^^^ ^ multi-campus institution or part of 

□ Yes □ No 

If Yes, write in the name of the institution; 



7. When this survey form has bean completed, pi 
Department of Education 
National Center for Education Statistics 
Room 3073, HEGIS 
400 Maryland Avenue, 
Washington, DX. 20202 



ease return before NOVEMBER 1^ 1981 to: 



OR 



to the HEGIS coordinator in your State, 
If there Is one. 
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Replaces OE Form 2?00-Z3. 4/77. which tt otaoletej 



Figure C-2 (continued) / 

This Report consists of three parts: 

Page Due Date 

M Institutional Information . . . i Nov. is, i98i 

Student Information 5-16 Nov. is, I98i 

3 Early Estimate Form 18 Oct is, I98i 




VOLUNTARY VERSUS REQUIRED REPORTING 

This survey constitutes an integral part of the comprehensive system of statistics on higher education 
collected by the National Center for Education Statistics ^VC£5; as part of the Higher Education Gene* 
ral Information Surey (HEGIS). 

In recent years, for the purpose of enforcing compliance with Federal regulations implementing civil 
rights laws applicable to institutions of higher education, the Office for Civil Rights ^OC/?; lias been col* 
lecting similar enrollment data on a mandatory basis* 

In order to lighten the burden on reporting institutions by eliminating the considerable duplication of 
effort in reporting enrollment data to two separate agencies* the two surveys have been combined into 
this single questionnaire and integrated into the HEG1S program. 

Completion of this questionnaire is mandatory for alt institutions of higher education which receive* are 
applicants for, or expect to be applicants for Federal financial assistance as defined in the Department 
of Health, Education and WtKsitt fMEW) regulation implementing. Title VI (45 CFR 80.13), or as de* 
Pined in any HEW regulation implementing Title IX. (See also the Insnvctions for completing this 
questionnaire.) 

Those institutions to which the regulations do not apply are not required to complete this questionnaire* 
However, it is hoped that institutions not subject to these provisions will voluntarily complete the en* 
tire survey*-or at least the Summary page-in order that the data may represent the entire universe of 
higher education* As a minimum NCES requests that institutions complete columns 13 through IS on 
the Summary page in order to enable NCES to continue to provide basic enrollment data serving the 
needs and interests of the higher education community. 
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